Surgical imaging device

ABSTRACT

A surgical imaging device includes at least one light source for illuminating an object, at least two image sensors configured to generate image data corresponding to the object in the form of an image frame, and a video processor configured to receive from each image sensor the image data corresponding to the image frames and to process the image data so as to generate a composite image. The video processor may be configured to normalize, stabilize, orient and/or stitch the image data received from each image sensor so as to generate the composite image. Preferably, the video processor stitches the image data received from each image sensor by processing a portion of image data received from one image sensor that overlaps with a portion of image data received from another image sensor. Alternatively, the surgical device may be, e.g., a circular stapler, that includes a first part, e.g., a DLU portion, having an image sensor a second part, e.g., an anvil portion, that is moveable relative to the first part. The second part includes an arrangement, e.g., a bore extending therethrough, for conveying the image to the image sensor. The arrangement enables the image to be received by the image sensor without removing the surgical device from the surgical site.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application relates to U.S. Patent Application Ser. No. 60/285,193,filed on Apr. 20, 2001, U.S. Patent Application Ser. No. 60/300,107,filed on Jun. 22, 2001, U.S. Patent Application Ser. No. 60/344,648,filed on Dec. 31, 2001, and U.S. Patent Application Ser. No. 60/352,726,filed on Jan. 30, 2002, each of which is expressly incorporated hereinby reference in its entirety.

This application also relates to U.S. patent application Ser. No.09/324,452, filed on Jun. 2, 1999 and issued as U.S. Pat. No. 6,443,973,U.S. application Ser. No. 09/723,715, filed on Nov. 28, 2000, U.S.application Ser. No. 09/324,451, filed on Jun. 2, 1999 and issued asU.S. Pat. No. 6,315,184, U.S. application Ser. No. 09/351,534, filed onJul. 12, 1999 and issued as U.S. Pat. No. 6,264,087, U.S. applicationSer. No. 09/510,923, filed on Feb. 22, 2000 and issued as U.S. Pat. No.6,517,565, U.S. application Ser. No. 09/510,927, filed on Feb. 22, 2000,U.S. application Ser. No. 09/510,932, filed on Feb. 22, 2000 and issuedas U.S. Pat. No. 6,491,201, U.S. application Ser. No. 09/836,781, filedon Apr. 17, 2001, U.S. patent application Ser. No. 09/887,789, filed onJul. 22, 2001, U.S. application Ser. No. 10/127,310, filed on Apr. 22,2002, and U.S. application Ser. No. 10/355,906, filed on Jan. 30, 2003,each of which is expressly incorporated herein in its entirety byreference.

FIELD OF THE INVENTION

The present invention relates to a surgical imaging device, and inparticular to a surgical imaging device that is configured to provideimage data of a surgical site.

BACKGROUND INFORMATION

It is typically important during a surgical procedure that a surgeon beable to view a surgical site so as to ensure that the surgical procedureis being performed correctly. However, there are many types of surgicalprocedures in which the surgeon is not able to see the surgical site.For instance, laparoscopic or endoscopic surgical procedures, in which asurgeon accesses a surgical site through very small incisions, preventthe surgeon from viewing the surgical site.

One method for performing surgical procedures of this type is to employsurgical devices that include arrangements for indicating the positionof components of the surgical devices while in use. For instance, asurgical device for such a surgical procedure may include a remotestatus indicator that provides an indication of the position of acomponent of the surgical device. By knowing the position of thecomponents of the surgical device, the surgeon may determine if thesurgical device is being operated correctly during the surgicalprocedure. A remote status indicator may provide this information to theuser via a LCD indicator which is coupled to an electromagnetic sensor.For example, a surgical instrument may include an anvil portion and astaple, blade and reservoir (SBR) portion. The surgical instrument maydetachably couple to an electromechanical driver device via a shaft. Thesurgeon advances the shaft and the SBR portion of the attachment intothe body cavity. The base of the anvil portion and the outer edge of theSBR housing may include an electromagnetic sensor which is coupled tothe LCD indicator of the handle, thereby permitting the surgeon to knowthe position of the anvil and the SBR during the surgical procedure.

Another method for performing surgical procedures of this type is toemploy a video camera or the like. For instance, various types ofcameras may be configured to be inserted through an incision in apatient and into a surgical site. Such cameras provide video data of thesurgical site during a surgical procedure, thereby allowing the surgeonto see the surgical procedure taking place in real time. However,because of the small size of the incision, once one of these cameras isinserted through an incision and into a surgical site, it may bedifficult to maneuver. In addition, these cameras provide only a singleview of the surgical site. If the surgeon needs to change the view ofthe surgical site, e.g., to examine the surgical site from a differentangle, the surgeon typically is required to remove the camera from thefirst incision, to make another incision in the patient, and to reinsertthe camera into the second incision.

For example, surgeons utilize various surgical instruments forinter-abdominal, inter-thoracic and other similar surgical procedures.Typically, surgeons desire to perform these procedures using minimallyinvasive surgical techniques. In an endoscopic procedure, for example, asmall incision is made, e.g., in a patient's abdomen, etc., and anendoscope is inserted therein in order to view the body cavity in whichthe surgeon intends to perform the surgery. These types of surgicalprocedures typically require the use of an endoscope which enables thesurgeon to obtain a view of the body cavity and the manipulation of asurgical device used during the surgery. Many times, the surgeon insertsboth the endoscope and the surgical device either through the sameincision or may use separate incisions for each device. In most surgicalprocedures using an endoscope, a member of the surgical team maycontinuously monitor the positioning of the endoscope in order maintaina suitable view of the body cavity and the manipulation of the surgicaldevice.

Another problem that is experienced by conventional surgical imagingsystems is that they do not provide an image that is adequately stable.For instance, U.S. Pat. No. 6,097,423, which is expressly incorporatedherein in its entirety by reference, describes that, in conventionalsurgical imaging systems, movement of a camera typically causesundesired changes in the image that is eventually displayed to andviewed by a user, e.g., surgeon.

Thus, there is a need for an improved surgical imaging device that isconfigured to provide image data of a surgical site for display to auser.

SUMMARY

In accordance with one example embodiment of the present invention, asurgical imaging unit is provided, including a housing configured todetachably couple to an outer surface of a surgical device, and an imagecapture arrangement configured to generate image data; the imaging unitmay also include a circuit arrangement disposed within the housing andelectrically coupled to the image capture arrangement, in which thecircuit arrangement is configured to communicate the image data to atleast one remote device.

In accordance with another example embodiment of the present invention,a surgical attachment is provided, including a surgical device, and animaging unit having a housing configured to detachably couple to anouter surface of the surgical device and an image capture arrangementconfigured to generate image data; the imaging unit may further includea circuit arrangement disposed within the housing and electricallycoupled to the image capture arrangement, in which the circuitarrangement is configured to communicate the image data to at least oneremote device.

In accordance with another example embodiment of the present invention,a surgical system is provided, including an electromechanical driverdevice, a surgical device detachably coupled to the electromechanicaldriver device, and an imaging unit having a housing configured to coupleto an outer surface of the surgical device and an image capturearrangement configured to generate image data; the imaging unit mayfurther include a circuit arrangement disposed within the housing andelectrically coupled to the image capture arrangement, in which thecircuit arrangement is configured to communicate the image data to atleast one remote device.

In accordance with another example embodiment of the present invention,a surgical imaging device is provided, wherein the surgical imagingdevice is configured to be inserted into a surgical site and wherein thesurgical imaging device includes a plurality of prongs. Each one of theprongs has an image sensor mounted thereon. The image sensors providedifferent image data corresponding to the surgical site, thus enabling asurgeon to view a surgical site from several different angles.

The prongs may be moveable between a first position, in which the prongsare substantially parallel to each other, and a second position, inwhich the prongs are not substantially parallel to each other. In thesubstantially parallel configuration, e.g., the first position, theprongs are configured to be inserted through an incision into thesurgical site. Once inserted through the incision into the surgicalsite, the prongs may be radially separated from each other by a userrotating control levers that are connected to the prongs by legs.

In addition, the prongs may be bendable between an extended position, inwhich the prongs are substantially perpendicular to their respectivelegs, and a retracted position, in which the prongs are notsubstantially perpendicular to their respective legs. Advantageously,the prongs are configured to bend in conformance with a shape of acavity that is formed in the surgical site by the actuation of anactuator configured to form such a cavity.

The surgical imaging device may be configured for operation in a wiredformat, a wireless format, or both. In the wired format, the device mayinclude a body portion having a slot in electrical communication withthe image sensors, a video display device configured to display theimage data, and a control cable that is configured to the transmit imagedata from the image sensor to the video display device. In the wiredformat, the device may also include a power supply coupleable to thecontrol cable for supplying power to the device. In the wireless format,the device may include a body portion having a first antenna and aremote control device having a second antenna, wherein the remotecontrol device is configured to provide a wireless control signal viathe second antenna to the device via the first antenna. In addition, inthe wireless format, the device may include a video display devicehaving an antenna, wherein the device is configured to generate via thefirst antenna a wireless signal corresponding to image data from theimage sensors, and wherein the video display device is configured toreceive the wireless signal and to provide a display corresponding tothe image data. In the wireless format, the device may also include alocal power supply for providing power to the device.

In accordance with another example embodiment of the present invention,a surgical imaging device is provided, which includes at least one lightsource for illuminating an object. The surgical imaging device alsoincludes at least two image sensors, each image sensor configured togenerate image data corresponding to the object in the form of an imageframe. The surgical imaging device further includes a video processorconfigured to receive from each image sensor the image datacorresponding to the image frames and to process the image data so as togenerate a composite image. The video processor may be configured tonormalize, stabilize and/or orient the image data received from eachimage sensor. In addition, the video processor may be configured tostitch the image data received from each image sensor so as to generatethe composite image. Preferably, the video processor stitches the imagedata received from each image sensor by processing a portion of imagedata received from one image sensor that overlaps with a portion ofimage data received from another image sensor.

In accordance with another example embodiment of the present invention,a surgical device for insertion into a surgical site is provided. Thesurgical device, e.g., a circular stapler, includes a first part, e.g.,a DLU portion, that includes an image sensor configured to receive animage. The surgical device includes a second part, e.g., an anvilportion, that is moveable relative to the first part. The second partincludes an arrangement, e.g., a bore extending therethrough, forconveying the image to the image sensor. The arrangement enables theimage to be received by the image sensor without removing the surgicaldevice from the surgical site. The surgical device may also include avideo processor in communication with the image sensor and configured toprovide image data corresponding to the image to a display unit. In oneembodiment, the image sensor and the arrangement are automaticallyaligned, for instance by the image and the arrangement being centrallydisposed, e.g., “on-axis”, within the first and second parts,respectively. In another embodiment, the image and the arrangement arenon-centrally disposed, e.g., “off-axis”, within the first and secondparts, respectively, and the image sensor and the arrangement arerotationally aligned via alignment mechanisms.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an exemplary surgical system, according to oneembodiment of the present invention.

FIG. 2 a illustrates a circular surgical stapler attachment, accordingto one embodiment of the present invention.

FIG. 2 b illustrates a linear surgical stapler, according to oneembodiment of the present invention.

FIG. 3 a illustrates a first exemplary imaging device configured tocouple to a surgical device, according to one embodiment of the presentinvention.

FIG. 3 b illustrates the imaging device of FIG. 3 a, with the surgicaldevice coupled to the imaging device.

FIG. 4 a illustrates an exemplary image capture arrangement, accordingto one embodiment of the present invention.

FIG. 4 b is a side view of the image capture arrangement illustrated inFIG. 4 a.

FIG. 5 illustrates an exemplary circuit arrangement, according to oneembodiment of the present invention.

FIG. 6 illustrates an exemplary power supply arrangement for providingelectrical power to an imaging device, according to one embodiment ofthe present invention.

FIG. 7 a illustrates another exemplary imaging device in the form of animaging pod, according to one embodiment of the present invention.

FIG. 7 b is a side view of the imaging device illustrated in FIG. 7 ashowing further detail.

FIG. 7 c illustrates a surgical attachment with an imaging pod coupledto a surgical device.

FIG. 8 a illustrates another exemplary imaging pod, according to oneembodiment of the present invention.

FIG. 8 b illustrates an exemplary receptacle of a surgical deviceconfigured to receive the imaging pod illustrated in FIG. 8 a.

FIG. 9 illustrates another exemplary surgical attachment, according toone embodiment of the present invention.

FIG. 10 shows a perspective view of a surgical imaging device, inaccordance with one embodiment of the present invention.

FIG. 11 illustrates a cross-sectional view of a body portion of thesurgical imaging device shown in FIG. 10, taken along the lines B-B.

FIG. 12 illustrates a prong having a camera, according to one embodimentof the present invention.

FIG. 13 is a cross-sectional view of the prong shown in FIG. 12, takenalong the lines A-A.

FIG. 14 illustrates a control cable, according to one embodiment of thepresent invention.

FIG. 15 illustrates the legs and prongs of the surgical imaging devicein a first position, according to one embodiment of the presentinvention.

FIG. 16 illustrates a cross-sectional view of the prongs shown in FIG.15, taken along the lines C-C.

FIG. 17 is a bottom view of the surgical imaging device shown in FIG.10.

FIG. 18 illustrates the surgical imaging device shown in FIG. 10 in aretracted position, according to one embodiment of the presentinvention.

FIG. 19 illustrates a wireless arrangement for wirelessly transmittingimage data for display on a video display device, according to oneembodiment of the present invention.

FIGS. 20( a) to 20(c) illustrate the operation of the surgical imagingdevice to perform an exemplary type of surgical procedure, according toone example embodiment of the present invention.

FIG. 21 illustrates a surgical imaging device having imaging sensorsprovided in a body portion, according to one example embodiment of thepresent invention.

FIG. 22 is a schematic diagram that illustrates an exemplary surgicalimage capture arrangement, in accordance with another embodiment of thepresent invention.

FIG. 23 is a schematic diagram that illustrates a plurality of imageframes.

FIG. 24 illustrates a flowchart of a video processing program, the stepsof which are performed during the operation of the surgical device inaccordance with one example embodiment of the present invention.

FIG. 25( a) illustrates a reference image frame according to one exampleembodiment of the present invention.

FIG. 25( b) illustrates a current image frame according to one exampleembodiment of the present invention.

FIG. 25( c) is a flow chart that illustrates, according to one exampleembodiment of the present invention, a frame stabilization procedurethat may be employed by the processor.

FIG. 26( a) illustrates a first image frame that overlaps with a secondimage frame, according to one example embodiment of the presentinvention.

FIG. 26( b) illustrates first image regions translating to second imageregions as a result of alignment vectoring.

FIG. 26( c) is a flow chart that illustrates, according to one exampleembodiment of the present invention, a frame stitching procedure thatmay be employed by the processor.

FIGS. 27( a) to 27(e) are side cross-sectional views that illustratevarious portions of a circular cutting/stapling device having an“off-axis” image system, according to one example embodiment of thepresent invention.

FIGS. 28( a) to 28(e) are side cross-sectional views that illustratevarious portions of a circular cutting/stapling device having an“on-axis” image system, according to another example embodiment of thepresent invention.

FIG. 29( a) is a perspective view of a surgical system, according to oneembodiment of the present invention.

FIG. 29( b) is a side view of the image capturing device, according toone embodiment of the present invention.

DETAILED DESCRIPTION

Referring now to FIG. 1, there is seen a surgical system 100. Surgicalsystem 100 includes an electromechanical driver device 110 detachablycoupled to a surgical attachment 120. Such an electro-mechanical driverdevice is described in, for example, U.S. patent application Ser. No.09/723,715, entitled “Electro-Mechanical Surgical Device,” filed on Nov.28, 2000, U.S. patent application Ser. No. 09/836,781, entitled“Electro-Mechanical Surgical Device, filed on Apr. 17, 2001, and U.S.patent application Ser. No. 09/887,789, entitled “Electro-MechanicalSurgical Device,” filed on Jun. 22, 2001, each of which is expresslyincorporated herein in its entirety by reference. Electro-mechanicaldriver device 110 may include, for example, a remote power console (RPC)105, which includes a housing 115 having a front panel 125. Mounted onfront panel 125 are a display device 130 and indicators 135 a, 135 b. Aconnection slot 140 is also provided on front panel 125.Electro-mechanical driver device 110 may also include a video display145, e.g., a television monitor, computer monitor, CRT or other viewingdevice, attached to the RPC 105. Video display 145 may receive, forexample, image signals (e.g., video signals) from an imaging device 195.The electromechanical driver device 110 may also include a receptionsystem 150 having a receiver or transceiver 155 and circuitry 160operable to convert signals received from the imaging device 195 into aform suitable for display on video display 145. The reception system 150may also include a memory device 165 for buffering and/or storingprocessed image data received from the imaging device 195.

A flexible shaft 170 may extend from housing 115 and may be detachablysecured thereto via a first coupling 175. The distal end 180 of flexibleshaft 170 may include a second coupling 185 adapted to detachably securethe surgical attachment 120 to the distal end 180 of the flexible shaft170.

Disposed within the interior channel of the flexible shaft 170, andextending along the length thereof, may be rotatable shafts, steeringcables, one or more data transfer cables and power transfer leads, allof which terminate at the second coupling 185 at the distal end 180 ofthe flexible shaft 170. The electro-mechanical driver device 110 mayinclude a motor system (not shown), which includes one or more motorsconfigured to rotate the drive shafts and to apply tension or otherwisedrive the steering cables to thereby steer the distal end 180 of theflexible shaft 170.

Various types of surgical devices 190 may be attached to the distal end180 of the flexible shaft 170, such as a circular surgical staplerattachment (CSS) 250, shown schematically in FIG. 2 a. Referring to FIG.2( a), the CSS 250 includes a coupling 255 adapted by size andconfiguration to cooperate with the second coupling 185 of flexibleshaft 170 to detachably couple the CSS 250 thereto. CSS 250 includes ananvil portion 260 having an anvil 265 mounted on the distal end of ananvil stem 270. The anvil stem 270 is extended and retracted by theoperation of an anvil drive shaft (not shown), which is rotatablysecured within the body portion 275 of the CSS 250. CSS 250 furtherincludes a staple driver/cutter mechanism (not shown) within the bodyportion 275. In operation, the extension and retraction of the anvil 265and the staple driver/cutter may be effected by the operation of motorswithin the electro-mechanical driver device 110. Movement and control ofthe anvil 265 and staple driver/cutter may be performed through the useof a remote control unit (not shown). The position and location of theanvil 265 and staple driver/cutter are indicated by signals transmittedto the electromechanical driver device 110 and displayed for the user onthe display device 130 and indicators 135 a, 135 b. CSS 250 furtherincludes a data connector (not shown) adapted to electrically andcommunicatively couple to second coupling 185.

Referring now to FIG. 2 b, there is seen another exemplary surgicaldevice 190 as a linear surgical stapler 205, such as described in detailin U.S. Pat. No. 6,443,973 which is expressly incorporated herein byreference in its entirety. The linear surgical stapler 205 may include aseparating jaw system comprising a lower jaw 210, an upper jaw 215 and acoupling 220. Coupling 220 may include two hexagonal shaped sockets 225a, 225 b into which second coupling 185 of flexible shaft 170 isdetachably received. At the distal tip of the upper jaw 215 and lowerjaw 210 may be situated two opposing magnetic sensors 230, 235, eachcoupled to a circuit component (not shown) which connects to theelectromechanical driver device 110 via flexible shaft 170. When thelower and upper jaws 210, 215 come together, the circuit is closed andindicators 135 a, 135 b of the electromechanical driver device 110provide a signal indicating that the stapling mechanism (not shown) oflower jaw 210 may be safely fired. The linear surgical stapler 205 mayalso include a shaft and driver component configured to close jaws 210,215 onto tissue and to drive staples into the tissue for closure. Themagnetic sensors 230, 235 and circuitry associated with the linearsurgical stapler attachment 205 may also, for example, provide a userwith an indication when a section of tissue has been fully clamped.

The linear surgical stapler 205 may also include electrodes (not shown).

The electrodes may receive RF energy through contacts 240 and enable thecoagulation and/or anastomosing of tissue. The linear surgical staplerattachment 205 may incorporate various electrode and/or staplingconfigurations, as described in U.S. Patent Application Ser. No.60/285,113, entitled “A Surgical Linear Clamping, Stapling, and CuttingDevice”, filed on Apr. 20, 2001 and U.S. Patent Application Ser. No.60/289,370, entitled “Bipolar Surgical Device” filed on May 8, 2001,each of which is expressly incorporated herein by reference in itsentirety.

Although FIG. 2 a, 2 b show only a circular surgical stapler and alinear surgical stapler, respectively, it should be appreciated that thesurgical device 190 may include other arrangements. For example,surgical device 190 may include a trocar device, as described in U.S.patent application Ser. No. 10/098,217, filed on Mar. 14, 2002, which isexpressly incorporated herein by reference.

Referring now to FIG. 3 a, there is seen a first exemplary imagingdevice 300 configured to couple to the surgical device 190, for example,a linear stapler or a circular surgical stapler. Imaging device 300includes a housing 305 having a bore 310, an image capture arrangement315 (e.g., a camera), a circuit arrangement 320 electrically coupled tothe image capture arrangement 315, and a power supply arrangement 330for supplying power to the imaging device 300.

The imaging device 300 is suitably configured to slidably receive thesurgical device 190 within bore 310. For this purpose, the surgicaldevice 190 may be inserted into the bore 310 in a first direction 325,as shown in FIG. 3 b. Once inserted, a coupling mechanism (not shown)may hold the surgical device 190 in place within the bore 310.

It should be appreciated that the coupling mechanism may include anyarrangement suitable for detachably holding the surgical device 190 inplace within the bore 310, such as, clamps, nuts, bolts, clasps, straps,a frictional-fit arrangement, a snap-fit arrangement, etc. Thus, theimaging device 300 may be detachably coupled to or mounted on an outersurface of the surgical device 190. Configured in this manner, after theimaging device 300 is used with the surgical device 190, the imagingdevice 300 may be removed from the surgical device 190 and reused onanother surgical device. This may be particularly advantageous if, forexample, the surgical devices are disposable with and it is desired toreuse the imaging device 300 several times. Of course, in an alternateembodiment, the surgical device 190 may be permanently coupled to theimaging device 300.

Although FIGS. 3 a, 3 b show bore 310 having a cylindrical shape, itshould be appreciated that bore 310 may be suitably shaped andconfigured to provide compatible attachment to other surgical devices,which may or may not be cylindrical in shape.

Referring now to FIG. 4 a, there is seen a frontal view of the imagecapture arrangement 315 illustrated in FIGS. 3 a, 3 b showing furtherdetail. As shown in FIG. 4 a, the image capture arrangement 315 includesa lens 405, a light source 410 for illuminating an object to be imaged(e.g., fiber optic light sources, light bulbs, LEDs, etc.), an imagesensor 440 (e.g., a light sensitive device such as a CCD or CMOS-typeimage sensor) positioned to capture an image via the lens 405. In oneembodiment, the image capture arrangement 315 may further include acleaning arrangement 415 for cleaning debris from the lens 405. Each ofthe lens 405, the light source 410, the image sensor 440, and thecleaning arrangement 415 is communicatively coupled to data bus 430.

In operation, the image sensor 440 receives an image as seen, forexample, from the distal end of the surgical device 190 via lens 405.The image capture arrangement 315 generates image data in accordancewith the image and communicates the image data to the circuitarrangement 320 via data bus 430.

In the exemplary embodiment shown, the image sensor 440 is positionedbehind the lens 405. However, the image sensor 440 may be arranged in aposition remote from the lens 405, with light from the lens 405 beingtransmitted to the image sensor 440 via, for example, fiber opticconnections. In one exemplary embodiment, the image sensor 440 ispositioned in the housing 305. In another exemplary embodiment, theimage sensor 440 is positioned in the flexible shaft 170, a couplingthereto, and/or the electromechanical driver device 110. In any event,image data may be transmitted to the electro-mechanical driver devicevia a wireless or wired connection.

Referring now to FIG. 4 b, there is a side view of the image capturearrangement 315 illustrated in FIG. 4 a. The cleaning arrangement 415may include, for example, hollow stems 420 for dispersing an air/watermixture across lens 405. For this purpose, proximal ends (not shown) ofthe hollow stems 420 may receive the air/water mixture from a remotesource (not shown), for example, the electro-mechanical driver device110. The air/water mixture is propelled through the hollow stems,exiting the distal ends 425 of the hollow stems 420. In this manner, theair/water mixture is dispersed across the lens 405 to help clean debrisfrom the lens 405 during use.

In addition to communicating the image data to the circuit arrangement320 via data bus 430, the image capture arrangement 315 receives controldata from the circuit arrangement 320 via the data bus 430. The controldata may, for example, control zooming of the lens 405, control theillumination produced by the light source 410, and/or control the flowrate of the air/water mixture propelled through the hollow stems 420 ofthe cleaning arrangement 415.

It should be appreciated that the image capture arrangement 315 mayinclude one or more lenses 405, one or more image sensors 440, and/orone or more light sources 410. Multiple lenses 405 and/or image sensors440 may permit a user to switch between different lenses 405 to obtainmultiple views at different perspectives. For example, the user may viewdifferent images through every step of a surgical procedure.Furthermore, multiple lenses may permit panoramic or wide views.

Referring now to FIG. 5, there is seen further detail of the circuitarrangement 320 illustrated in FIGS. 3 a, 3 b. The circuit arrangement320 includes circuitry suitable for receiving the image data from theimage capture arrangement 315 and communicating the image data to aremote source, such as the electro-mechanical driver device 110. Thecircuitry may be physically situated, for example, on a rigid orflexible circuit board situated within the housing 305 of the imagingdevice 300. Circuit arrangement 320 may include a processing arrangement505, a memory device 510, user input arrangement 525, and a transmissionarrangement 515, each of which is communicatively coupled via data bus520. The data bus 430 of the image capture arrangement 315 is alsocommunicatively coupled to the data bus 520. In this manner, the imagedata may be received from the image capture arrangement 315 andcommunicated to the processing arrangement 505 and/or the memory device510 via data bus 520.

The memory device 510 may include any read/writable memory devicecapable of storing the image data, such as RAM, FLASH, EPROM, EEPROM,etc. The image data received from the image capture arrangement 315 maybe, for example, stored directly on the memory device 510 for subsequentprocessing by the processing arrangement 505. In this manner, the memorydevice 510 receives the image data from the image capture arrangement315 and then communicate the image data to the processing arrangement505. Alternatively, the image data may be transmitted directly to theprocessing arrangement 505 for processing. In this manner, theprocessing arrangement 505 receives the image data from the imagecapture arrangement 315 directly via the data bus 520. Additionally, thememory device 510 may receive and store processed image data from theprocessing arrangement 505 for subsequent additional processing and/orfor direct transmission to the remote device via the transmissionarrangement 515. Alternatively, the image data may be transmitteddirectly from the image capture arrangement 315 to a processor of theelectromechanical driver device 110.

The user input arrangement 525 is configured to receive commands from auser. The commands may include, for example, commands to zoom the lens405, to switch between different views, to receive continuous (e.g.,video) or still images, to control the illumination produced by thelight source 410, to control the flow rate of the air/water mixturepropelled through the hollow stems 420 of the cleaning arrangement 415,to switch to panoramic view, etc.

For this purpose, the user input arrangement 520 may include, forexample, a wireless receiver for receiving the commands wirelessly froma remote control unit. Alternatively, the user input arrangement 520 mayinclude, for example, electrical contacts for communicatively couplingto the electromechanical driver device 110 via wires disposed within theflexible shaft 170 or external to the flexible shaft 170. In thismanner, the user input arrangement 520 may receive the commands via theremote power console 105 of the electromechanical driver device 110.

The user input arrangement 520 generates user input data in accordancewith the commands received from the user and communicates the user inputdata to the processing arrangement 505 via the data bus 520. Theprocessing arrangement 505 is configured to control the image capturearrangement 315 and process the image data in accordance with the userinput data received from the user input arrangement 520.

To control the image capture arrangement 315, the processing arrangement505 may generate control data for controlling the various functions ofthe image capture arrangement 315 in accordance with the user input datareceived from the user input arrangement 520. For this purpose, theprocessing arrangement 505 communicates the control data to the imagecapture arrangement 315 via data buses 430, 520. The control data may,for example, control zooming of the lens 405, control the illuminationproduced by the light source 410, and/or control the flow rate of theair/water mixture propelled through the hollow stems 420 of the cleaningarrangement 415.

The processing arrangement 505 also processes the image data inaccordance with the user input data received from the user inputarrangement 520. In this manner, the processing arrangement 505 mayprocess the image data to communicate continuous or still images, toperform a digital zoom, etc. In this manner, the imaging device 300 mayprovide a surgeon with a video image as the surgical attachment 120 isinserted and probed through, for example, the colon area of a patient.Both moving and still images may be provided to surgeon via the imagingdevice 300. For example, while the surgeon is probing the colon tolocate cancerous tissue, the imaging device 300 may supply a continuousimage of the colon. Should the surgeon encounter an image that he or shewould prefer to view as a still image, the surgeon may instantaneouslyfreeze the moving image by activating the corresponding controlmechanisms. Accordingly, the freeze frame image may be manipulated asdesired, i.e., rotated, zoomed and/o magnified. The moving images mayalso be stored and manipulated as desired for subsequent visualanalysis.

The transmission arrangement 515 receives the processed image data fromthe processing arrangement 505 via the data bus 520 and communicates theprocessed image data to the remote device (not shown). For this purpose,the transmission arrangement 515 may include a wireless transmitteroperable to convert the processed image data into an RF transmission tobe wirelessly received by the remote device. Alternatively, thetransmission arrangement 515 may include, for example, electricalcontacts for communicatively coupling to the electro-mechanical driverdevice 110 via wires disposed within or external to the flexible shaft170. In this manner, the transmission arrangement 515 may communicatethe processed image data to the video display 145 of theelectromechanical driver device 110.

Referring now to FIG. 6, there is seen further detail of the exemplarypower supply arrangement 325 illustrated in FIGS. 3 a, 3 b. Power supplyarrangement 325 includes a battery power unit 605 for providingelectrical power to the imaging device 300. The battery power unit 605may include, for example, nickel cadmium batteries, nickel metal-hydridebatteries, lithium batteries, etc. In addition to or in lieu of thebattery power unit 605, power supply arrangement 325 may include powercontacts 610 for receiving electrical power from an external source (notshown), for example, the electromechanical driver device 110. In thismanner, the electro-mechanical driver device 110 may transmit theelectrical power to the power supply arrangement 325 via wires disposedwithin or external to the flexile shaft 170.

The battery power unit 605 may be configured, for example, to provideelectrical power to the imaging device 300 if the power contacts 610 arenot receiving electrical power from the external source, for example,from the electro-mechanical driver device 110. In this manner, thebattery power unit 605 may function as a “battery-backup,” to ensurethat the imaging device 300 receives electrical power in the event powertransmission from the external source is interrupted and/or removed.

Referring now to FIG. 7 a, there is seen another exemplary imagingdevice in the form of imaging pod 700. The imaging pod 700 includes ahousing 705 having an attachment arrangement 710 and an image capturearrangement 715 situated within the housing. The image capturearrangement 715 includes one or more light sources 730 and an opticalsystem 720 with a focusing lens 735. The attachment arrangement 710 mayinclude, for example, pins, spring loaded bearings, ridges, etc.configured to detachably couple the imaging pod 700 to a correspondingreceptacle of the surgical device 190. The housing 705 may be formed of,for example, a transparent plastic material, although the housing may beformed of other materials as well.

Referring now to FIG. 7 b, there is seen further detail of imaging pod700 illustrated in FIG. 7 a. As seen in FIG. 7 b, the image capturearrangement 715 further includes an imaging sensor, e.g., a lightsensitive device such as a charged coupled device (CCD) 725. As theimaging pod is directed toward an object to be imaged, the focusing lens735 focuses reflected light onto CCD 725. A wireless transmitter (or,e.g., a transceiver) 740 is situated in the housing 705 andcommunicatively coupled to the CCD 725. An example of such a wirelesstransmitter is described in U.S. Pat. No. 5,604,531, expresslyincorporated herein by reference in its entirely. Additionally, a powersource 745, such as a small battery, is situated in the housing 705 andoperable to provide electrical power to the CCD 725, light sources 730,and the wireless transmitter 740. In operation, images captured by CCD725 may be wirelessly transmitted via wireless transmitter 740 to acorresponding receiver (or transceiver) in a remote device, such as theelectromechanical driver device 110.

Although, the present embodiment is described as using a CCD as an imagesensor, other suitable image sensors may also be used, such as a CMOS(Complementary Metal Oxide Semiconductor) type image sensor. The CMOSsensor may require less power than a CCD image sensor, due to itsgreater sensitivity to light. A CMOS image sensor may include, forexample, a photo diode and/or a photo transistor to detect reflectedlight from an object to be imaged. The CMOS image sensor may transmitthe image data as an analog signal or, alternatively, as a digitalsignal after processing by an analog-digital converter.

Referring now to FIG. 7 c, there is seen a surgical attachment 750including the imaging pod 700 coupled to surgical device 190. Theimaging pod 700 is detachably received within a receptacle 755 of thesurgical device 190. Accordingly, if the surgical device 190 is designedas a disposable unit, the imaging pod 700 may be removed from thesurgical device 190 and reused in connection with another surgicaldevice. Alternatively, the imaging pod 700 may be permanently securedto, or even integral with, the surgical device 190. In this regard, thepermanently coupled imaging pod 700 would be disposed along with thesurgical device 190.

Referring now to FIG. 8 a, there is seen another exemplary imaging pod800. Imaging pod 800 is similar to the imaging pod 700 described inconnection with FIGS. 7 a, 7 b, 7 c, except that imaging pod 800includes wired connections for transmitting the image data to the remotedevice, such as the electromechanical driver device 110. As shown inFIG. 8, the imaging pod 800 includes contact pins 805 sized to bereceived in sockets of the receptacle 755 of the surgical device 190,thereby providing a plug-in type connection. When the imaging pod 800 isinserted in the surgical device 190, the contact pins 805 provideconnections to circuitry 760, which supplies power to the appropriatecomponents of the imaging pod 800 and transmits signals from the CCD 725to a corresponding receiver in the remote device, such as theelectromechanical driver device 110, through, for example, the surgicaldevice 190 and the flexible shaft 170.

Referring now to FIG. 8 b there is seen an exemplary receptacle 755 ofthe surgical device 190 configured to receive the imaging pod 180. Asshown in FIG. 8 b, the receptacle 755 includes sockets 810 sized toreceive the contact pins 805 of the imaging pod 800. The sockets 810electrically couple the contact pins 805 to electrical leads (not shown)in the surgical device 190. The electrical leads are electricallyconnected to the remote device (e.g., the electromechanical driverdevice 110) via wires situated, for example, within the flexible shaft170 of the electro-mechanical driver device 110.

It should be appreciated that the imaging pod 800 may include a batteryfor power, and utilize wired transmission for signals from the CCD, oralternatively, receive power via a wired connection and utilize wirelesstransmission for the signals from the CCD.

Referring now to FIG. 9, there is seen another exemplary surgicalattachment 900. In this embodiment, an imaging device 905 is configuredto be coupled to or mounted on an external surface of the surgicaldevice 190. Of course, the imaging device 905 may also be configured tomount on other surgical devices, such as those described in the U.S.applications incorporated by reference above.

In accordance with this exemplary embodiment, the surgical device 190 isa circular surgical stapler. The imaging device 905 is mounted to a body910 of the surgical device 190. The surgical device 190 includes acoupling 915, an anvil portion 920 and a body 910. The anvil portion 920includes an anvil 925 and anvil stem 930. A flexible wire assembly 940is provided for communicating image data to a remote device, e.g., theelectromechanical driver device 110 (not shown).

The imaging device 905 may slidingly fit over the body 910 and may beeither permanently or removably mounted to the body 910. In the exampleembodiment shown in FIG. 9, the imaging device 905 is removably mountedto the body 910 via a resilient, e.g., plastic or elastic strap 935.Strap 935 may be removed, for example, which may permit the imagingdevice 905 to be reused with another surgical device or attachment.Alternatively, the imaging device 905 may be mounted to the surgicaldevice 190 via a shoe (not shown) similar to the type used with a flashunit on a camera.

The video unit 100 may be coupled, for example, to a processor via awireless connection or a wired connection via flexible wire assembly940. The flexible wire assembly 940 may include power, control and datalines. The flexible wire assembly 940 may be coupled to, for example, aprocessor of a remote power console as described in, for example, U.S.patent application Ser. No. 09/836,781. Of course, in lieu of theflexible wire assembly 940, the wired connection between the imagingdevice 905 and, for example, the processor, may be effected viaindividual wires disposed within or external to the flexible shaft 170of the electromechanical driver device 110.

It should be appreciated that the wires of the flexible wire assembly940 and/or the wires disposed within or external to the flexible shaft170 of the electro-mechanical driver device 110 for communicating imagedata from the imaging device 905 to, for example, the processor, may bereplaced with fiber-optic connections.

Imaging device 905 may include analogous features to the imaging devices300 and 700 described above. For example, imaging device 905 may includean image capture arrangement (e.g., a camera), a circuit arrangementelectrically coupled to the image capture arrangement, and a powersupply arrangement for supplying power to the imaging device 905.

The image capture arrangement of the imaging device 905 may include alens, a light source for illuminating an object to be imaged (e.g.,fiber optic light sources, light bulbs, LEDs, etc.), an image sensor(e.g., a CCD or CMOS-type image sensor) positioned to capture an imagevia the lens. In one embodiment, the image capture arrangement of theimaging device 905 may further include a cleaning arrangement forcleaning debris from a lens. Each of the lens, the light source, theimage sensor, and the cleaning arrangement may also communicativelycoupled to data bus.

FIG. 10 shows a perspective view of a surgical imaging device 100according to another example embodiment of the present invention. Thesurgical imaging device 1100 includes a body portion 104 which encloseslegs 1106 a to 1106 d and a retraction actuator 1102. The legs 1106 a to1106 d are connected to levers 1112 a to 1112 d, respectively. Prongs1108 a to 1108 d extend from legs 1106 a to 1106 d, respectively.Located at or near the distal tip of each prong 1108 a to 1108 d is acamera 1114 a to 1114 d, respectively.

According to one embodiment of the present invention, the legs 1106 a to1106 d, along with their respective prongs 1108 a to 1108 d, aremoveable. For instance, the legs 1106 a to 1106 d may be moveable withina cylindrical opening of the body portion 1104 (explained in more detailbelow) so that the legs 1106 a to 1106 d move radially around a centralaxis 1104 a of the body portion 1104. In addition, the legs 1106 a to1106 d may be rotatably moveable, e.g., rotatable around their owncentral axes, within the body portion 1104, so that the prongs 1108 a to1108 d may be caused to swivel around the central axes of the legs 1106a to 1106 d, respectively. The legs 1106 a to 1106 d may be moveable inboth of these ways by the operation of the levers 1112 a to 1112 d,respectively, as further described below. The control levers 1112 a to1112 d extend through opening 1111. Specifically, the movement of thelegs 1106 a to 1106 d within the body portion 1104 is more fullydescribed below in connection with FIGS. 15, 16 and 17.

In addition, the prongs 1108 a to 1108 d may be moveable relative totheir respective legs 1106 a to 1106 d. For instance, the prongs 1108 ato 1108 d may be moveable between an extended position, in which eachprong 1108 a to 1108 d is positioned in substantially the same plane,e.g., each being substantially perpendicular to its respective legs 1106a to 1106 d, and a retracted position, in which each prong 1108 a to1108 d is not positioned in substantially the same plane, e.g., is notsubstantially perpendicular to its respective legs 1106 a to 1106 d. Themovement of the prongs 1108 a to 1108 d between an extended position anda retracted position is more fully described below in connection withFIG. 18.

The body portion 1104 may also include a memory device 1161. In oneembodiment of the present invention, the memory device 1161 stores datacorresponding to the surgical imaging device 1100. Data stored in thememory device 1161 may include model/serial number identification 1161a, usage data 1161 b, image data 1161 c and processing data 1161 d. Themodel/serial number identification 1161 a uniquely identifies thesurgical imaging device 1100. The usage data 1161 b may include, e.g.,information concerning the number of hours the surgical imaging device1100 has been used and the types of procedures that have been viewedusing the surgical imaging device 1100. The image data 1161 c mayinclude, e.g., video clips, still frames, etc., which depict visualimages of the body cavity. In one embodiment of the present invention,the user may label and categorize the image data 1161 c while using theimaging device 1100 during a surgical procedure. In addition, the usagedata 1161 b and image data 1161 c may be transferred for permanentstorage on a storage device, e.g., floppy disk, CD, hard drive disk,etc., so that a surgeon may review the stored data at a future date.

The body portion 1104 may also include a processor 1161 d. In oneembodiment of the present invention, the processor 1161 d is configuredto process data, such as image data 1161 c, and may include, e.g., anoperating program which controls the operation of the surgical imagingdevice 1100 or that controls the processing of the data, e.g., the imagedata 1161 c. For instance, the processor 1161 d may include an operatingprogram that controls or operates the various functions of the surgicalimaging device 1100, such as lens movement, adjustment of lightintensity, zoom magnification, color, brightness and focus.

The body portion 1104 of the surgical imaging device 1100 may alsoinclude a slot 1105 configured to receive a control cable 1200, asfurther described below in connection with FIG. 14. Generally, thecontrol cable 1200 conveys data and/or power between the cameras 1114 ato 1114 d and a video display device 1205 and/or a power supply 1210.

FIG. 11 illustrates a cross-sectional view of the body portion 1104shown in FIG. 10, taken along the lines B-B. As previously mentioned, inthis embodiment, the legs 1106 a to 1106 d connect to control levers1112 a to 1112 d, respectively. The control levers 1112 a to 1112 dextend through opening 1111 and may be movable in a radial directionrelative to the central axis 1104 a of the body portion 1104. The legs1106 a to 1106 d extend axially through the body portion 1104 and out ofcylindrical opening 1107. The opening 1111 is configured so as toprovide sufficient movement to the control levers 1112 a to 1112 d toenable the legs 1106 a to 1106 d to be moved between different positionsin the cylindrical opening 1107 of the body portion 1107, as furtherdescribed below.

As described above, located at or near the distal tip of prongs 1108 ato 1108 d are cameras 1114 a to 1114 d, respectively. FIGS. 12 and 13illustrate a prong 1108 having a camera 1114, according to oneembodiment of the present invention. In FIG. 12 there is shown a camera1114 that includes a lens 1116 and an imaging sensor 1118. One or morelight sources 1115 may be mounted adjacent to the camera 1114 andprovide light to enable the imaging sensor 1118 to sense an image. Theprong 1108 may also include a control line 1122 having control and powerleads that transmit power to the imaging sensor 1118 and to the lightsources 1155, and/or transmit image data signals to and from the imagingsensor 1118. The light sources 1115 may include, e.g., light-emittingdiodes.

FIG. 13 is a cross-sectional view of the prong 1108 shown in FIG. 12,taken along the lines A-A. FIG. 13 illustrates the camera 1114 includinga pair of lenses 1116, lens covers 1120 for protecting the lenses 1116,and the imaging sensor 1118. The imaging sensor 1118 may be, forexample, a charged coupled device (hereinafter referred to as a “CCD”).The imaging sensor 1118 receives an image from lens 1116 and convertsthe image to image data, e.g., electronic signals, for transmissionthrough the control line 1122. The camera 1114 may also include internalcircuitry that converts images captured by the imaging sensor 1118 intoelectrical signals for transmission to a video display device.

Although one embodiment of the present invention employs a CCD as theimaging sensor 1118, other suitable imaging sensors may also be used. Inanother exemplary embodiment of the present invention, the imagingsensor 1118 is an integrated circuit using a Complementary Metal OxideSemiconductor (hereinafter referred to as “CMOS”) process. A CMOS typeimage sensor may include a photo diode or photo transistor as the lightdetecting element. Furthermore, a CMOS image sensor may transmit analogsignals or use an analog-digital converter for signal transmission. TheCMOS sensor may provide an alternative to the CCD sensor that wouldrequire less power during operation due to its greater sensitivity tolight. U.S. patent application Ser. No. 10/127,310, filed on Apr. 27,2002, which is expressly incorporated herein by reference in itsentirety, describes other possible imaging devices and arrangements thatmay be used in connection with the example embodiment.

FIG. 14 illustrates a control cable 1200 according to one embodiment ofthe present invention. The control cable 1200 includes coupling 1211,leads 1215 and coupling 1212. The control cable 1200 is configured toattach, via coupling 1211, to slot 1105 located on body portion 1104.Leads 1215 transmit signals to and from the imaging sensors 1118 in eachcameras 1114 a to 1114 d. In addition, leads 1215 may transmit power forenergizing the various components of the cameras 1114 a to 1114 d. Thecoupling 1212 is configured to attach to the video display device 1205,such as a television monitor, computer monitor, CRT or similar viewingdevice, which receives and processes the image data for viewing, and/orto attach to a power supply 1205.

As described above, in one embodiment of the present invention, the legs1106 a to 106 d, along with their respective prongs 1108 a to 1108 d,are moveable between various positions. For instance, the legs 1106 a to1106 d, along with their respective prongs 1108 a to 1108 d, may bemoveable between a first position, in which the prongs 1108 a to 1108 dare parallel to each other, and a second position, in which the distalends of the prongs 1108 a to 1108 d are not parallel to each other. FIG.15 illustrates the legs 1106 a to 1106 d, along with their respectiveprongs 1108 a to 1108 d, in a first position. In this first position,the legs 1106 a to 1106 d are rotated in the body portion 1104 such thatthe distal ends of the prongs 1108 a to 1108 d, e.g., the ends of theprongs 1108 a to 1108 d having the cameras 1114 a to 1114 d,respectively, are positioned adjacent to each other. In one embodimentof the present invention, the prongs 1108 a to 1108 d are configured soas to fit together, thereby reducing the cross-sectional area of thedistal ends of the prongs 1108 a to 1108 d. For instance, FIG. 16illustrates a cross-sectional view of the prongs 1108 a to 1108 d shownin FIG. 15, taken along the lines C-C, wherein the distal ends of theprongs 1108 a to 1108 d each have a complementary cross-sectional shaperelative to each other so as to minimize the cross-sectional areas ofthe prongs 1108 a to 1108 d when parallel to each other. This parallelposition is suitable for maneuvering the prongs 1108 a to 1108 d intoand out of an incision in a patient, as more fully described below.

FIG. 10, explained in detail above, illustrates the legs 1106 a to 1106d, along with their respective prongs 1108 a to 1108 d, in the secondposition. In this second position, the legs 1106 a to 1106 d are rotatedin the body portion 1104 such that the prongs 1108 a to 1108 d are movedwithin a substantially same plane, e.g., a plane that is substantiallyperpendicular to the central axis 1104 a of the body portion 1104, so asto be not parallel to each other. For instance, FIG. 10 illustrates thelegs 1106 a to 1106 d, along with their respective prongs 1108 a to 1108d, rotated in the body portion 1104 such that the prongs 1108 a to 1108d are radially separated relative to each other and positionedapproximately 90 degrees apart from each other relative to the centralaxis 1104 a of the body portion 1104.

Another view of the legs 1106 a to 1106 d and the prongs 1108 a to 1108d in the second position is shown in FIG. 17. FIG. 17 is a bottom viewof the surgical imaging device 1100 shown in FIG. 10. In the embodimentshown in FIG. 17, arrows F illustrate the directions that the legs 1106b, 1106 c and 1106 d may move within the cylindrical opening 1107 of thebody portion 1104. In addition, arrows G illustrate the directions thatthe prongs 1108 a to 1108 d may move when their respective legs 1106 ato 1106 d are rotated around their respective central axes.

As previously mentioned, in addition to the movement of the legs 1106 ato 1106 d and their prongs 1108 a to 1108 d as shown in FIG. 17, theprongs 1108 a to 1108 d are also moveable between an extended positionand a retracted position. FIG. 10, described above, illustrates theprongs 1108 a to 1108 d in an extended position, in which each prong1108 a to 1108 d is in a substantially same plane, e.g., each beingsubstantially perpendicular to its respective legs 1106 a to 1106 d.FIG. 18, on the other hand, illustrates the surgical imaging device 1100in a retracted position. As mentioned previously, in the embodimentshown, the prongs 1108 a and 1108 b of the surgical imaging device 1100are not substantially perpendicular to their respective legs 1106 a to1106 d in the retracted position. In the retracted position, the prongs1108 a to 1108 d of the surgical imaging device 1100 are moved relativeto their respective legs 1106 a to 1106 d such that the camera 1114 a to1114 d of each of the prongs 1108 a to 1108 b is directed to a region ofspace. In one embodiment of the present invention, the prongs 1108 a to1108 d of the surgical imaging device 1100 are moved relative to theirrespective legs 1106 a to 1106 d such that the imaging sensor 1118mounted in each of the prongs 1108 a to 1108 b is directed to the sameregion of space, such as region of space 1201 illustrated in FIG. 18.The region of space 1201 may be a region of space in which a surgicalinstrument is being used during a surgical procedure. Thus, in thisembodiment, in the retracted position, the imaging sensor 1118 of eachof the prongs 1108 a to 1108 b provide a view of a surgical site duringa surgical procedure from a different angle. Alternatively, the prongs1108 a to 1108 d of the surgical imaging device 1100 may be moved suchthat the imaging sensor 1118 of each of the prongs 1108 a to 1108 b aredirected to different regions of space.

In one embodiment, the surgical imaging device 1100 is moved from anextended position into the retracted position by the actuation of theretraction actuator 1105. The retraction actuator 1105 moves axiallyrelative to the body portion 1104 such that, during retraction, thebottom portion 1110 of the retraction actuator 1102 moves away from thebody portion 1104 in the direction indicated by arrow R. The prongs 1108a to 1108 d are preferably made of a flexible material, enabling theprongs 1108 a to 1108 d to bend when force is exerted thereon. Forinstance, as the bottom portion of the retraction actuator 1102 is movedinto a body cavity, a force may be exerted on the prongs 1108 a to 1108d by the walls of a body cavity. As a result, the prongs 1108 a to 1108d may be caused to bend and may form, as shown in FIG. 18, a curvedshape. In one embodiment, the curved shape of each of the prongs 1108 ato 1108 d conform to the walls of the body cavity in which the prongs1108 a to 1108 d are disposed. In this manner, the imaging sensor 1118positioned at the tip of each prong 1108 a to 1108 d may provide a userwith multiple views of the body cavity area. In addition, the user mayrotate each prong 1108 a to 1108 d in order to view the body cavity fromvarious angles.

As previously described, the image data may be transmitted via thecontrol cable 1200 inserted at one end into the slot 1105 of the bodyportion 1104 and inserted at the other end to a video display device1205. Alternatively, the image data may be transmitted wirelessly fordisplay on a video display device. For instance, the surgical imagingdevice 1100 may include a wireless arrangement for wirelesslytransmitting the image data for display on a video display device. FIG.19 illustrates one embodiment of the present invention that employs awireless arrangement for wirelessly transmitting the image data fordisplay on a video display device. Specifically, and as illustrated inFIG. 19, the surgical imaging device 1100 may include an antenna 1145 aconfigured to transmit image data and/or control signals. The antenna1145 a of the surgical imaging device 1100 may receive control signals1148 from the antenna 1145 b of a remote control unit 1147. Thesecontrol signals may include, for instance, signals that control theimaging sensors 1118, the intensity of the light provided by the lightsources 1115, or any other signals for controlling the operation of thesurgical imaging device 1100. In addition, the surgical imaging device1100 may transmits video signals 1158 via the antenna 1145 a of thesurgical imaging device 1100 to an antenna 1150 a of a video displaydevice 1150.

In another embodiment, the cameras 1114 a to 1114 d may include wirelesscircuitry that enables the transmission of wireless signals 1158directly to the video display device 1150. Since the wireless embodimentof the surgical imaging device 1100 enables the control cable 1200 andthe power supply 1210 to be eliminated, the surgical imaging device 1100may, as shown in FIG. 19, include a local power source, e.g., a battery,1109. The local power source 1109 may supply power to the imagingsensors 1118, the light sources 1115, any additional internal circuitryin the cameras 1114 a to 1114 d, etc. In this wireless embodiment of thepresent invention, the surgical imaging device 1100 may also eliminatethe slot 1105 of the body portion 1104 (shown in FIG. 10) that isconfigured to receive the control cable 1200.

In still another embodiment, the surgical imaging device 1100 may beequipped to alternatively function in either a wired or wireless format.In this embodiment, the slot 1105 may have a cover which would enablethe user to cover the slot 1105 when the imaging device 1100 is operatedwirelessly. Should the user desire to operate the surgical imagingdevice 1100 in a wired format, the user may remove the cover and attachthe control cable 1200 into the slot 1105. In this embodiment, theoperating program for the imaging device 1100 is advantageouslyconfigured to detect when the control cable 1200 is or is not attachedto the slot, and to operate the surgical imaging device 1100 in eitherthe wired or the wireless formats in accordance therewith.

In another example embodiment of the present invention, one or moreimaging sensors, e.g., imaging sensors 1118, may be provided in the bodyportion, e.g., body portion 1104, or in a remote device. FIG. 21illustrates one example embodiment having imaging sensors 1118 providedin the body portion 1104. In this embodiment, the prongs 1108 a to 1108d include light guides, such as light guides 315 a to 315 d, and/or alens system, such as lens systems 314 a to 314 d, which guide lightreflected in the body cavity to the imaging sensors 1118 a to 1118 d inorder to remotely capture an image of the body cavity. For example,fiber optics may be used in this regard.

The surgical imaging device 1100 of the present invention may be used invarious types of surgical procedures. FIGS. 20( a) to 20(c) illustratethe operation of the surgical imaging device 1100 to perform anexemplary type of surgical procedure, e.g., abdominal surgery. It shouldbe recognized that this is merely one of many types of surgicalprocedures that may be performed with the surgical imaging device 1100of the present invention. According to this exemplary procedure andreferring to FIG. 20( a), an incision 1199 is made in the abdominal wallAW to the peritoneal fat layer PFL. The prongs 1108 a to 1108 d areinserted through the incision 1199. In order to facilitate the insertionof the prongs 1108 a to 1108 d and to minimize the size of the incisionrequired, the prongs 1108 a to 1108 d may be positioned by the user inthe first position, e.g., the first position illustrated in FIG. 15wherein the prongs 1108 a to 1108 d are parallel to each other. As theprongs 1108 a to 1108 d are inserted they separate the peritoneum P fromthe properitoneal fat layer PFL.

After the prongs 1108 a to 1108 d and the bottom portion 1110 have beeninserted into the incision, the user may use the control levers 1112 ato 1112 d to separate the prongs 1108 a to 1108 d. FIG. 20( b)illustrates the surgical imaging device 1100 after the prongs 1108 a to1108 d and the bottom portion 1110 have been inserted into the incisionand the prongs 1108 a to 1108 d have been separated. As shown in FIG.20( b), the prongs 1108 a to 1108 d may be separated until the prongs1108 a to 1108 d are in the second position, e.g., the second positionillustrated in FIGS. 10 and 17 wherein the prongs 1108 a to 1108 d areapproximately 90 degrees apart from each other relative to the centralaxis 1104 a of the body portion 1104.

After the prongs 1108 a to 1108 d are separated the user may applydownward pressure to the retraction actuator 1102. As the user extendsretraction actuator 1102 through the incision, the bottom portion 1110of the retraction actuator 1102 pushes on the peritoneum P so that theperitoneum P is detached from the properitoneal fatty layer PFL, butwithout piercing the peritoneum P. In this manner, a cavity C is formedbetween the abdominal wall AW and the peritoneum P, allowing a surgeonwith space to perform a surgical procedure. FIG. 20( c) illustrates thesurgical imaging device 1100 after the bottom portion 1110 of theretraction actuator 1102 has pushed the peritoneum P so as to form thecavity C between the abdominal wall AW and the peritoneum P. FIG. 20( c)also illustrates that during the extension of retraction actuator 1102and as the cavity C is formed between the abdominal wall AW and theperitoneum P, the prongs 1108 a to 1108 d are caused to bend inconformance with the curvature of the properitoneal fatty layer PFL.Once the prongs 1108 a to 1108 d are placed in the retracted position asshown in FIG. 20( c), the surgeon may provide power via power supply1210 to the light sources 1115 and to the imaging sensors 1118 so as togenerate image data of the cavity C. In this retracted position, theimage sensors 1118 of each of the prongs 1108 a to 1108 d providemulti-directional views of the cavity C, allowing a surgeon to view thesurgical procedure being performed in the cavity C from various angles.If additional views are required, the surgeon may manipulate the controllevers 1112 a to 1112 d until the desired view is obtained.

Thus, the surgical imaging device of the present invention in accordancewith various embodiments thereof, may reduce the difficulty in obtainingdifferent views of a surgical site in a body cavity. Unlike conventionalsurgical cameras, which require a surgeon to remove the camera from afirst incision, to make another incision in the patient, and to reinsertthe camera into the second incision in order to change the view of thesurgical site and/or to examine the surgical site from a differentangle, the surgical imaging device of the present invention permitsmultiple views to be seen without removing the device. Instead, thesurgeon may view the surgical site from different angles simply byviewing the image data from the various image sensors situated indifferent locations within the surgical site. Furthermore, if theseviews are inadequate, the surgeon may move the prongs 1108 a to 1108 das desired via the control levers 1112 a to 1112 d to obtain new viewswithout the need to remove the device or make additional surgicalincisions. Still further, the surgical imaging device of the presentinvention in accordance with various embodiments thereof provides for asingle device that enables a cavity to be formed in the surgical site,thereby providing space for performing the surgical procedure. Inaddition, the surgical imaging device of the present invention inaccordance with various embodiments thereof provides for one or morelight sources that provide light in the surgical site, thereby enablingthe image sensors to provide useful image data without the need formaking additional incisions to insert additional light sources.

FIG. 22 is a schematic diagram that illustrates an exemplary surgicalimage capture arrangement 1500, in accordance with one embodiment of thepresent invention. As shown in FIG. 22, the image capture arrangement1500 includes at least one light source 1510, such as light sources 1510a, 1510 b, 1510 c and 1510 d. It should be recognized that any number oflight sources 1510 may be employed. The light source 1510 is configuredto illuminate an object to be imaged. As set forth more fully above, thelight source 1510 may be, for example, a fiber optic light source, lightbulbs, LEDs, etc. FIG. 22 illustrates one possible arrangement, havingfour light sources 1510, such as might be employed to illuminate anabdominal cavity (shown schematically as cavity 1501), or any othercavity, of a patient. For the purposes of example only, the arrangementdescribed below refers to a surgical image capture arrangement 1500 thatis employed within an abdominal cavity 1501 of a patient. Preferably,the light sources 1510 are positioned within the abdominal cavity 1501so as to illuminate the abdominal cavity 1501 from various angles so asto insure that the abdominal cavity and objects within the abdominalcavity 1501 are adequately illuminated from all angles.

The image capture arrangement 1500 also includes at least two imagesensors 1540. In the embodiment shown, the image capture arrangement1500 includes six image sensors 1540, shown here as image sensors 1540a, 1540 b, 1540 c, 1540 d, 1540 e and 1540 f. It should be recognizedthat any number of image sensors 1540 may be employed. The image sensors1540 are each configured to capture an image, e.g., via a lens. As setforth more fully above, the image sensor 1540 may be, for example, alight sensitive device such as a CCD or CMOS-type image sensor.Preferably, the image sensors 1540 are positioned within the abdominalcavity 1501 so as to capture images that correspond collectively to theentire abdominal cavity 1501. However, it should be recognized that,while the image sensors 1540 are preferably positioned within theabdominal cavity 1501 so as to capture images that correspondcollectively to the entire abdominal cavity 1501, in other embodiments,the image sensors 1540 are positioned within the abdominal cavity 1501so as to capture images that correspond collectively to a portion lessthan the entirety of the abdominal cavity 1501. In addition, the imagesensors 1540 are preferably positioned within the abdominal cavity 1501relative to the light sources 1510 that are also positioned within theabdominal cavity 1501 so as to capture images that are adequatelyilluminated by the light sources 1510.

An image that is captured by each respective image sensor 1540 isreferred to herein as an image frame. FIG. 23 is a schematic diagramthat illustrates a plurality of image frames 5400. As shown in FIG. 23,each image frame 5400 corresponds to an image that is captured by animage sensors 1540. For instance, the image frame 5401 corresponds tothe image that is captured by the image sensor 1540 a. Likewise, theimage frames 5402, 5403, 5404, 5405 and 5406 correspond to the imagesthat are captured by the image sensors 1540 b, 1540 c, 1540 d, 1540 eand 1540 f, respectively.

Preferably, the image sensors 1540 are positioned within the abdominalcavity 1501 such that the image frames captured by each image sensor1540 overlap to form a composite image. FIG. 23 illustrates that theimage frames 5401 to 5406 captured by the image sensors 1540 a to 1540f, respectively, overlap to form a composite image 5407. The compositeimage 5407 may include selected portions of each of the image frames5401 to 5406. As stated above, the composite image 5407 preferablycorresponds to an image of the entire abdominal cavity 1501. However, inother embodiments, the composite image 5407 corresponds to an image of aportion of the abdominal cavity 1501. In one embodiment, the compositeimage 5407 has an aspect ratio of 16:9. In another embodiment, thecomposite image 5407 has an aspect ratio of 4:3. It should be recognizedthat the composite image 5407 may have any conceivable aspect ratio. Itis noted that, while FIG. 23 illustrates the composite view 5407 of theabdominal cavity 1501 in a front view, FIG. 22 also illustrates thecomposite view 5407, but in a top view. Thus, FIG. 22 illustrates onemanner in which multiple image sensors 1540 may be employed to generatethe composite view 5407.

FIG. 24 illustrates a flowchart of a video processing program, the stepsof which are performed during the operation of the surgical device inaccordance with one example embodiment of the present invention.According to one example embodiment of the present invention, the videoprocessing routine may be stored in and executed by, e.g., the processor1161 d shown in FIG. 10. However, it should be understood that othercontrollers, electronic devices, etc. may be configured to execute someor all of the steps illustrated in FIG. 24.

In step 2302, at least two image sensors, such as image sensors 1510 ato 1510 f illustrated in FIG. 22, provide image data in the form of animage frame. In step 2302, the image frames from each image sensor, suchas the image frames 5401 to 5406 from the image sensors 1540 a to 1540f, respectively, are provided as input to the video processor. For thepurposes of example only, the flowchart of FIG. 24 is explainedhereinbelow as being performed by the processor 1161 d shown in FIG. 10,although it should be recognized that any video processor that isconfigured to perform the steps described hereinbelow may be employed inthe present invention.

In step 2304, the processor 1161 d performs a frame normalizationprocedure. More specifically, the processor 1161 d normalizes the imageframes, e.g., the image frames 5401 to 5406, received from each of theimage sensors, e.g., 1540 a to 1540 f, respectively, by adjusting, ifnecessary, the image frames so as to be of the same size relative toeach other. In addition, in step 2304, the processor 1161 d performs aframe orientation procedure. More specifically, the processor 1161 dorients the image frames, e.g., the image frames 5401 to 5406, receivedfrom each of the image sensors, e.g., 1540 a to 1540 f, respectively, byrotating, if necessary, the image frames so as to be similarly orientedrelative to each other.

In step 2306, the processor 1161 d performs a frame stitching procedure.More specifically, the processor 1161 d stitches together the normalizedand oriented image frames, e.g., the image frames 5401 to 5406, receivedfrom each of the image sensors, e.g., 1540 a to 1540 f, respectively.According to one embodiment, the processor 1161 d performs the framestitching procedure of step 2306 by identifying those portions, e.g.,pixels, of the image frames 5401 to 5406 that are in common with eachother, e.g., those portions of the image frames 5401 to 5406 thatoverlap relative to each other. One example of a frame stitchingprocedure that may be employed by the processor 1161 d is set forth inadditional detail below in connection with the flow chart illustrated inFIG. 26( c).

After performing the frame stitching procedure of step 2306, theprocessor 1161 d then generates in step 2308 a full virtual field ofview, such as the composite image 5407 illustrated in FIG. 23.Furthermore, at step 2308, the processor 1161 d may be configured toperform an image stabilization procedure. The image stabilizationprocedure is advantageously performed in order to stabilize the imagedisplayed to the user such that movement of the image sensors 1114 a to1114 d, e.g., rotation in a first direction, does not result in acorresponding change, e.g., a rotation in a second direction in theimage that is displayed to and viewed by the user. One example of astabilization procedure that may be employed by the processor 1161 d isset forth in additional detail below in connection with the flow chartillustrated in FIG. 25( c).

In step 2310, a user input device, such as the remote control unit 1147illustrated in FIG. 19, may be employed in order to generate controlsignals, e.g., control signals 1148, that are received by the processor1161 d and that the processor 1161 d employs to establish or adjustorientation data points for the composite image 5407. For instance, anoperator may employ, e.g., a joystick or other control device, so as toestablish or adjust the orientation of the composite image 5407 bymoving one or more of the image sensors 1540. In the event that a userinput device, e.g., the remote control unit 1147, is employed in orderto establish or adjust orientation data points for the composite image5407 in step 2310, the processor 1161 d may re-perform step 2308 so asto again generate a full virtual field of view, such as a new compositeimage 5407, in accordance with the orientation data points that wereestablished or adjusted in step 2310. The processor 1161 d therebyinsures via step 2308 that the composite image 5407 remains properlyoriented regardless of, for instance, a movement or reorientation of theimage sensors.

The processor 1161 d may then selectively generate in step 2312 a regionof interest corresponding to a portion of the full virtual field ofview, e.g., a portion of the composite image 5407. In step 2316, a userinput device, such as the remote control unit 1147, may be employed inorder to generate control signals, e.g., control signals 1148, that arereceived by the processor 1161 d and that the processor 1161 d employsto select a portion of the composite image 5407. For instance, anoperator may employ, e.g., a joystick or other control device, so as toselectively display a desired portion of the composite image 5407, e.g.,the image frame of one or more of the image sensors 1540. In oneembodiment, the processor 1161 d also has an optional auto-trackfeature. According to this embodiment, in step 2316, the processor 1161d is configured to automatically adjust the region of interest selectedby a user. In this manner, the region of interest originally selected bya user in step 2316 may be adjusted so as to, e.g., continue displayinga surgical instrument as the surgical instrument is moved within theabdominal cavity 1501.

In still another embodiment, a user input device, such as the remotecontrol unit 1147, may be employed in order to zoom into or out of aportion of the composite image 5407. For instance, an operator mayemploy, e.g., a joystick or other control device, to generate controlsignals, e.g., control signals 1148, that are received by the processor1161 d and that the processor 1161 d may employ to selectively zoom intoor out of a desired portion of the composite image 5407. According tothis embodiment, in step 2314, the processor 1161 d is configured toautomatically adjust the region of interest selected by a user inaccordance with signals provided by an operator.

In step 2318, the processor 1161 d generates a display, e.g., forviewing by an operator. Of course, the image that is displayed in step2318 may be, e.g., the composite image 5407 of the entire abdominalcavity generated in step 2308, a region of interest of the compositeimage 5407 corresponding to a selected portion of the abdominal cavityas generated in step 2312, a zoomed image etc. In step 2318, the imagemay be displayed on any suitable display device, for instance in step2320 on a wireless personal display monitor such as the wireless videodisplay device 1150 illustrated in FIG. 19, in step 2332 on an overheaddisplay monitor such as the wired video display device 145 illustratedin FIG. 1, etc.

As previously mentioned, FIG. 25( c) is a flow chart that illustrates,according to one example embodiment of the present invention, a framestabilization procedure that may be employed by the processor 1161 d. Atstep 2502, the processor 1161 d starts the frame stabilization process.At step 2504, the processor 1161 d acquires an image frame, e.g., imageframe 5401, from an image sensor, e.g., image sensor 540 a, and storesthe image frame 5401 as a reference image frame 2550. For instance, FIG.25( a) illustrates a reference image frame 2550 according to one exampleembodiment of the present invention.

Referring back to FIG. 25( c), at step 2506, the processor 1161 ddivides the reference image frame 2550 into a plurality of imageregions. For instance, FIG. 25( a) illustrates the reference image frame2550 divided into nine reference image regions, designated as referenceimage regions R1 through R9. It should be understood that, FIG. 25( a)illustrates the reference image frame 2550 divided into nine referenceimage regions, in other embodiments, the reference image frame 2550 maybe divided into any number of reference image regions.

At step 2508, the processor 1161 d acquires a current image frame, e.g.,image frame 5401, from an image sensor, e.g., image sensor 540 a. Forinstance, FIG. 25( b) illustrates a current image frame 2560 accordingto one example embodiment of the present invention. In addition, at step2508, the processor 1161 d divides the current image frame 2560 into aplurality of current image regions. Advantageously, the processor 1161 ddivides the current image frame 2560 into a plurality of current imageregions that are generally similarly disposed relative to the referenceimage regions into which the reference image frame 2550 was divided atstep 2506. For instance, FIG. 25( b) illustrates the current image frame2560 divided into nine current image regions, designated as imageregions R1′ through R9′.

At step 2510, the processor 1161 d evaluates, for each region in thecurrent image frame 2560, a correlation measurement relative to eachregion in the reference image frame 2550. At step 2512, the processor1161 d evaluates a motion vector for each current image region in thecurrent image frame 2560. Preferably, the processor 1161 d performs thisevaluation by selecting, for each current image region in the currentimage frame 2560, the reference image region in the reference imageframe 2550 that has the closest match, e.g., the minimum number ofcorrelation co-efficients relative to the current image region in thecurrent image frame 2560.

At step 2514, the processor 1161 d evaluates a global motion vectorcorresponding to the entire current image frame 2560. Preferably, theprocessor 1161 d evaluates the global motion vector corresponding to theentire current image frame 2560 such that the global motion vector isbased on the individual motion vectors determined at step 2512 for eachcurrent image region in the current image frame 2560.

At step 2516, the processor 1161 d determines whether the global motionvector determined at step 2514 exceeds a predetermined stabilizationvalue. If the processor 1161 d determines at step 2516 that the globalmotion vector does not exceed the predetermined stabilization value,then the processor 1161 d proceeds to step 2518. At step 2518, theprocessor 1161 d applies the global motion vector determined at step2514 to each pixel of the current image frame 2560. In addition, at step2518, the processor 1161 d produces, from the pixels of the currentimage frame 2560 that have had applied thereto the global motion vector,an output frame. The output frame is, for instance, the image that isdisplayed to the user. The processor 1161 d returns to step 2508 so asto acquire a new current image frame 2560 and to repeat the subsequentsteps 2510, 2512, etc.

If the processor 1161 d determines at step 2516 that the global motionvector does exceed the predetermined stabilization value, then theprocessor 1161 d proceeds to step 2520. At step 2520, the processor 1161d communicates the stabilization error, for instance by providing anerror message to the user. In addition, at step 2520, the processor 1161d provides to the user an opportunity to capture a new reference imageframe 2550.

At step 2522, the processor 1161 d determines whether user elected atstep 2520 to capture a new reference image frame 2550. If the processor1161 d determines at step 2522 that the user did not elect to capture anew reference image frame 2550, then the processor 1161 d returns tostep 2508 so as to acquire a new current image frame 2560 and to repeatthe subsequent steps 2510, 2512, etc. If the processor 1161 d determinesat step 2522 that the user did elect to capture a new reference imageframe 2550, then the processor 1161 d returns to step 2504 so as toacquire a new reference image frame 2560 and to repeat the subsequentsteps 2506, 2508, etc.

Additional methods for performing a frame stabilization procedure may beemployed by the processor 1161 d. For instance, according to one exampleembodiment of the present invention, the processor 1161 d is configuredto perform the image stabilization procedure described in “Implementinga Gray-Code Bit-Plane Matching Image Stabilization Algorithm on a XilinxFPGA”, Allen et al., which is expressly incorporated herein by referencein its entirety. According to another example embodiment of the presentinvention, the processor 1161 d is configured to perform the imagestabilization procedure described in “Digital Image Stabilization”,Samsung Electronics Co., 1997, which is also expressly incorporatedherein by reference in its entirety.

As previously mentioned, FIG. 26( c) is a flow chart that illustrates,according to one example embodiment of the present invention, a framestitching procedure that may be employed by the processor 1161 d. Atstep 2602, the processor 1161 d starts the frame stitching process. Atstep 2604, the processor 1161 d acquires an image frame from each imagesensor, e.g., camera, having overlapping fields of view. For instance,the processor 1161 d may acquire a first image frame from a first cameraand a second image frame from a second camera. FIG. 26( a) illustrates afirst image frame 2650 that overlaps with a second image frame 2660,according to one example embodiment of the present invention.

Referring back to FIG. 26( c), at step 2606, the processor 1161 ddivides the overlapping portions of the first image frame 2650 and thesecond image frame 2660 into a plurality of overlap image regions. Forinstance, FIG. 26( a) illustrates that, in the overlapping portions ofthe first image frame 2650 and the second image frame 2660, the firstimage frame 2650 is divided into three overlap image regions, designatedas first overlap image regions R1 through R3, while the second imageframe 2660 is divided into three overlap image regions, designated assecond overlap image regions R1′ through R3′. It should be understoodthat, while FIG. 26( a) illustrates the overlapping portions of each ofthe first image frame 2650 and the second image frame 2660 divided intothree overlap image regions, in other embodiments, the overlappingportions of each of the first image frame 2650 and the second imageframe 2660 may be divided into any number of overlap image regions.

At step 2610, the processor 1161 d evaluates, for each overlap imageregion in the first image frame 2650, a correlation measurement relativeto each overlap image region in the second image frame 2660. At step2612, the processor 1161 d evaluates an alignment vector for eachoverlap image region in the first image frame 2660. Preferably, theprocessor 1161 d performs this evaluation by selecting, for each overlapimage region in the first image frame 2560, the overlap image region inthe second image frame 2550 that has the closest match, e.g., theminimum number of correlation coefficients relative to the overlap imageregion in the first image frame 2650.

At step 2614, the processor 1161 d evaluates a global alignment vectorcorresponding to the entire second image frame 2660. Preferably, theprocessor 1161 d evaluates the global alignment vector corresponding tothe entire second image frame 2660 such that the global alignment vectoris based on the individual alignment vectors determined at step 2612 foreach second image region in the second image frame 2660.

At step 2616, the processor 1161 d determines whether the globalalignment vector determined at step 2614 exceeds a predeterminedstitching value. If the processor 1161 d determines at step 2616 thatthe global alignment vector does not exceed the predetermined stitchingvalue, then the processor 1161 d proceeds to step 2618. At step 2618,the processor 1161 d applies the global alignment vector determined atstep 2614 to each pixel of either the first or the second image frame2650, 2660. In addition, at step 2618, the processor 1161 d produces,from the pixels of either the first or second image frame 2560, 2660that have had applied thereto the global alignment vector, a compositeoutput frame. The composite output frame includes the first image frame2560 aligned with the second image frame 2660. The composite outputframe may be displayed to the user. The processor 1161 d then returns tostep 2604 so as to acquire an image frame from each camera havingoverlapping fields of view and to repeat the subsequent steps 2510,2512, etc.

If the processor 1161 d determines at step 2616 that the globalalignment vector does exceed the predetermined stitching value, then theprocessor 1161 d proceeds to step 2620. At step 2620, the processor 1161d communicates the stitching error, for instance by providing an errormessage to the user. In addition, at step 2620, the processor 1161 dprovides to the user an opportunity to capture new first and secondimage frames 2650, 2660.

At step 2622, the processor 1161 d determines whether the user electedat step 2620 to capture new first and second image frames 2650, 2660. Ifthe processor 1161 d determines at step 2622 that the user did not electto capture new first and second image frames 2650, 2660, then theprocessor 1161 d returns to step 2604 so as to acquire an image framefrom each camera having overlapping fields of view and to repeat thesubsequent steps 2606, 2608, etc. If the processor 1161 d determines atstep 2622 that the user did elect to capture new first and second imageframes 2650, 2660, then the processor 1161 d returns to step 2604 so asto acquire an image frame from each camera having overlapping fields ofview and to repeat the subsequent steps 2606, 2608, etc.

As set forth more fully above, it is typically important that during asurgical operation a surgeon be able to view a surgical site, and theinstruments that are employed within a surgical site, in order to insurethat the surgical procedure is performed correctly. The presentinvention also contemplates various embodiments that accomplish theobjective in connection with surgical instruments such as surgicalstaplers and the like. FIGS. 27( a) to 27(e) are a series of sidecross-sectional views that illustrate various portions of a circularcutting/stapling device 2800 having an off-axis image system, accordingto one example embodiment of the present invention. FIGS. 28( a) to28(e), on the other hand, are a series of side cross-sectional viewsthat illustrate various portions of a circular cutting/stapling device2900 having an on-axis image system, according to another exampleembodiment of the present invention.

Referring to FIG. 27( a), there is shown a side cross-sectional viewthat illustrates a DLU portion 2802 of a surgical device 2800, e.g., acircular cutting/stapling device such as may be employed in ananastomosing surgical procedure. The DLU portion 2802 includes a trocar2804 which is axially moveable relative to the DLU portion 2802 along acentral axis 2806, for instance by operation of a first rotatable driveshaft driven by the electromechanical driver device 110 and housedwithin the flexible shaft 170 illustrated in FIG. 13. FIG. 27( a)illustrates the trocar 2804 in a retracted position within the DLUportion 2802.

The DLU portion 2802 also includes a first image sensor portion 2808.The first image sensor portion 2808 is positioned within the DLU portion2802 along a second axis 2810. The second axis 2810 is different fromthe central axis 2806, e.g., off-axis. The first image sensor portion2808 includes a housing 2812 having an opening at its distal end. Withinthe housing 2812 is positioned an image capture arrangement 2814.According to one embodiment of the present invention, the image capturearrangement 2814 may include a first lens 2816 and an image sensor 2818,e.g., a camera, positioned behind the opening of the housing 2812.Advantageously, the first image sensor portion 2808 is positioned withinthe DLU portion 2802 such that it is axially recessed relative to aclamping surface 2820 of the DLU portion 2802. The image capturearrangement 2814 may be configured to generate image data in accordancewith an image and to communicate the image data to a processor, e.g.,the circuit arrangement 320 shown in FIG. 3( b) via a data transmissioncable, e.g., the data bus 430 shown in FIG. 4( b).

It should be recognized that, while FIG. 27( a) illustrates the imagesensor 2818 being positioned directly behind the first lens 2816, inother embodiments, the image sensor 2818 may be arranged in a positionremote from the first lens 2816, with light from the first lens 2816being transmitted to the image sensor 2818 via, for example, fiber opticconnections. In one exemplary embodiment, the image sensor 2818 ispositioned in the DLU portion 2802. In another exemplary embodiment, theimage sensor 2818 is positioned in a shaft, e.g., the flexible shaft 170shown in FIG. 1, in a coupling thereto, e.g., the first coupling 175and/or the second coupling 185 shown in FIG. 1, and/or in a driverdevice, e.g., the electromechanical driver device 110 shown in FIG. 1.In any event, image data may be transmitted to the driver device, e.g.,the electromechanical driver device 110 shown in FIG. 1, via a wirelessor wired connection. The surgical device 2800 may also include acleaning system 2827. The cleaning system 2827 may be configured toclean the image sensor 2818 and/or the first lens 2816.

FIG. 27( b) is a side cross-sectional view that illustrates the DLUportion 2802 of a surgical device 2800. In FIG. 27( b), the trocar 2804is axially advanced in a distal direction along a central axis 2806, soas to be in an extended position within the DLU portion 2802.

FIG. 27( c) is a side cross-sectional view that illustrates an anvilportion 2830 that is mounted on the DLU portion 2802 of the surgicaldevice 2800. Specifically, the anvil portion 2830 is mounted via atrocar receiving sleeve 2832 on the DLU portion 2802 so as to be axiallyfixed relative to the trocar 2804, and so as to be axially moveablerelative to the DLU portion 2802 along a central axis 2806 when thetrocar 2804 is moved between the retracted and the extended positions.FIG. 27( c) illustrates the trocar 2804 and the anvil portion 2832 inthe extended position relative to the DLU portion 2802.

The anvil portion 2830 also includes a second image sensor portion 2834.The second image sensor portion 2834 is positioned within the anvilportion 2830 along a third axis 2836. The third axis 2836 is differentfrom the central axis 2806, e.g., off-axis. In the preferred embodiment,DLU portion 2802 and the anvil portion 2830 are configured so as to havean alignment mechanism 2838, e.g., corresponding keys and/or keyways,slots, etc., such that, when the anvil portion 2830 is mounted via atrocar receiving sleeve 2832 on the trocar 2804 of the DLU portion 2802,the third axis 2836 is aligned with the second axis 2810.

The second image sensor portion 2834 includes a tube 2840. Within thetube 2840 is positioned a second lens 2842. According to one embodimentof the present invention, the tube 2840 has a sharp end 2842 a thatextends in the proximal direction. The cleaning system 2827 shown inFIG. 27( a) may also be configured to clean the second lens 2842.Advantageously, the tube 2840 has an inner diameter that corresponds to,e.g., is slightly larger than, an outer diameter of the housing 2812 ofthe first image sensor portion 2808 in the DLU portion 2802. The tube2840 extends through the anvil portion 2830 so as to enable light to beconveyed from a distal end of the tube 2840, e.g., through an opening2846 in the anvil, through the second lens 2842 and through the proximalsharp end 2842 a of the tube 2840.

FIG. 27( d) is a side cross-sectional view that illustrates the trocar2804 and the anvil portion 2830 in the retracted position relative tothe DLU portion 2802. FIG. 27( e) is a side cross-sectional view thatillustrates the trocar 2804 and the anvil portion 2832 in the retractedposition relative to the DLU portion 2802 as shown in FIG. 27( d) but ingreater detail. As illustrated in FIG. 27( e), the anvil portion 2830 isretracted relative to, e.g., so as to be adjacent to, the DLU portion2802. In this position, the tube 2840 of the anvil portion 2830surrounds the housing 2812, and the first lens 2816 of the first imagesensor portion 2808 is aligned with the second lens 2842 of the secondimage sensor portion 2834.

In operation, the trocar 2804 is initially retracted to the positionillustrated in FIG. 27( a) so as to enable the DLU portion to beinserted into a body of a patient, e.g., a gastrointestinal tract. Thetrocar 2804 is then extended into the position illustrated in FIG. 27(b), and the trocar 2804 is used to puncture a closed section of thegastrointestinal tract. The anvil portion 2830 is positioned within asecond, adjoining section of the gastro-intestinal tract, and the trocar2804 is inserted within the trocar receiving sleeve 2832 of the anvilportion 2830 so as to mount the anvil portion 2830 to the trocar 2804.The alignment mechanism 38 ensures that the DLU portion 2802 isrotationally aligned relative to the anvil portion 2830. The trocar 2804is then retracted until the anvil portion 2830 is approximately adjacentto the clamping surface 2820 of the DLU portion 2802. In this position,tissue of the gastrointestinal tract is clamped between the anvilportion 2830 and the clamping surface 2820 of the DLU portion 2802.While the trocar 2804 is being retracted relative to the DLU portion2802, the sharp end 2842 a of the tube 2842 punctures the tissue of thegastro-intestinal tract that is clamped between the anvil portion 2830and the clamping surface 2820 of the DLU portion 2802. The cleaningsystem 2827 may be employed, either automatically or manually, to cleanthe image sensor 2816, the first lens 2818 and the second lens 2842 ofblood or other bodily fluids or tissue that result from the puncturingof the section of tissue with sharp end 2842 a of the tube 2842.

As the trocar 2804 is further retracted relative to the DLU portion2802, the tube 2840 of the anvil portion 2830 slides over the housing2812 of the first image sensor portion 2808 such that the first lens2816 of the first image sensor portion 2808 is aligned with the secondlens 2842 of the second image sensor portion 2834. In this manner,light, e.g., an image, is conveyed from a distal end of the tube 2840,e.g., through an opening 2846 in the anvil, through the second lens2842, towards the proximal sharp end 2842 a of the tube 2840, throughthe first lens 2816 and to the image sensor 2818. The image sensor 2818of the image capture arrangement 2814 may then generate image datacorresponding to the image and communicate the image data for furtherprocessing to a processor, e.g., the circuit arrangement 320 shown inFIG. 3( b) via a data transmission cable, e.g., the data bus 430 shownin FIG. 4( b).

The surgical device 2800 illustrated in FIGS. 27( a) to 27(e) providesan arrangement that enables a user to view the a surgical site withoutfirst removing the surgical device 2800 from the surgical site. Forinstance, in accordance with the above-described embodiment of theinvention, a surgeon may perform an anastomosing procedure by clampingand stapling a section of tissue between the anvil portion 2830 and theDLU portion 2802 of the surgical device 2800. The surgeon may then viewthe integrity of the stapled section of tissue via the image sensor2818, which is configured to provide an image of the surgical sitethrough the tube 2840, without the need to remove the surgical device2800 from the surgical site. To obtain a full view of the surgical site,e.g., the staple line, the DLU portion 2802 may be rotated within thesurgical site, depending, e.g., on the geometry of the anvil portion2830. The surgical device 2800 illustrated in FIGS. 27( a) to 27(e) alsoprovides an advantage in that many of the components of the surgicaldevice 2800 are similar or common to components that may be employed ina surgical device without such an optics/imaging system, therebypromoting interchangability of parts between such surgical devices.

As previously mentioned, FIGS. 28( a) to 28(e) are a series of sidecross-sectional views that illustrate various portions of a circularcutting/stapling device 2900 having an “on-axis” image system, accordingto another example embodiment of the present invention. Referring toFIG. 28( a), there is shown a side cross-sectional view that illustratesa DLU portion 2902 of a surgical device 2900, e.g., a circularcutting/stapling device such as may be employed in an anastomosingsurgical procedure. The DLU portion 2902 includes a trocar extension2904 onto which is mounted a trocar head 2905. Preferably, the trocarhead 2905 is removably mounted onto the trocar extension 2904. Thetrocar extension 2904, and thus the trocar head 2905 mounted thereon,are axially moveable relative to the DLU portion 2902 along a centralaxis 2906, for instance by operation of a first rotatable drive shaftdriven by the electromechanical driver device 110 and housed within theflexible shaft 170 illustrated in FIG. 13. FIG. 28( a) illustrates thetrocar extension 2904 and the trocar head 2905 in a retracted positionwithin the DLU portion 2902.

The trocar extension 2904 is at least partially hollow and has anopening at its distal end. In addition, the trocar head 2905 has a boreextending therethrough in the axial direction. By virtue of its at leastpartially hollow interior, the trocar extension 2904 may includetherewithin a first image sensor portion 2908. The first image sensorportion 2908 is positioned within the trocar extension 2904 along asecond axis 2910. Preferably, the second axis 2910 coincides with, e.g.,is coaxial relative to, the central axis 2906, e.g., “on-axis”. Thefirst image sensor portion 2908 includes an image capture arrangement2914. According to one embodiment of the present invention, the imagecapture arrangement 2914 may include a first lens 2916 and an imagesensor 2918, e.g., a camera. The image capture arrangement 2914 may beconfigured to generate image data in accordance with an image and tocommunicate the image data to a processor, e.g., the circuit arrangement320 shown in FIG. 3( b) via a data transmission cable, e.g., the databus 430 shown in FIG. 4( b).

It should be recognized that, while FIG. 28( a) illustrates the imagesensor 2918 being positioned directly behind the first lens 2916, inother embodiments, the image sensor 2918 may be arranged in a positionremote from the first lens 2916, with light from the first lens 2916being transmitted to the image sensor 2918 via, for example, fiber opticconnections. In one exemplary embodiment, the image sensor 2918 ispositioned in the trocar extension 2904. In another exemplaryembodiment, the image sensor 2918 is positioned in a shaft, e.g., theflexible shaft 170 shown in FIG. 1, in a coupling thereto, e.g., thefirst coupling 175 and/or the second coupling 185 shown in FIG. 1,and/or in a driver device, e.g., the electromechanical driver device 110shown in FIG. 1. In any event, image data may be transmitted to thedriver device, e.g., the electromechanical driver device 110 shown inFIG. 1, via a wireless or wired connection.

FIG. 28( b) is a side cross-sectional view that illustrates the DLUportion 2902 of a surgical device 2900. In FIG. 28( c), the trocarextension 2904, onto which is mounted the trocar head 2905, is axiallyadvanced in a distal direction along a central axis 2906, so as to be inan extended position relative to the DLU portion 2902. In FIG. 28( c),the trocar head 2905 is removed from the distal end of the trocarextension 2904.

FIG. 28( d) is a side cross-sectional view that illustrates an anvilportion 2930 being mounted on the DLU portion 2902 of the surgicaldevice 2900. Specifically, the anvil portion 2930 is mounted via atrocar receiving sleeve 2932 on the trocar 2904 so as to be axiallyfixed relative to the trocar 2904, and so as to be axially moveablerelative to the DLU portion 2902 along the central axis 2906 when thetrocar 2904 is moved between the retracted and the extended positions.FIG. 28( d) illustrates the trocar 2904 and the anvil portion 2932 inthe extended position relative to the DLU portion 2902.

The anvil portion 2930 also includes a second image sensor portion 2934.The second image sensor portion 2934 is positioned within acentrally-disposed and axially-extending bore 2940 defined by the anvilportion 2930. Preferably, the bore 2940 defines a third axis 2936, whichcoincides with, e.g., is coaxial relative to, the central axis 2906,e.g., “on-axis”.

The second image sensor portion 2934 includes within the bore 2940 asecond lens 2942. Advantageously, the tube 2940 has an inner diameterthat corresponds to, e.g., is slightly larger than, an outer diameter ofthe trocar extension 2904 of the DLU portion 2902. The inner diameter ofthe tube 2940 and the outer diameter of the trocar extension 2904 of theDLU portion 2902 advantageously have corresponding engagement mechanisms2938 which enable the anvil portion 2930 to be mounted to and axiallyfixed in position relative to the trocar extension 2904. The bore 2940extends through the anvil portion 2930 so as to enable light to beconveyed from a distal end of the bore 2940, through the second lens2942 and through the proximal end of the tube 2940.

FIG. 28( e) is a side cross-sectional view that illustrates the trocarextension 2904 and the anvil portion 2930 in the retracted positionrelative to the DLU portion 2902. As illustrated in FIG. 28( e), theanvil portion 2930 is retracted relative to, e.g., generally adjacentto, the DLU portion 2902.

In operation, the trocar extension 2904, with the trocar head 2905mounted thereon, is initially retracted to the position illustrated inFIG. 28( a) so as to enable the DLU portion 2902 to be inserted into abody of a patient, e.g., a gastro-intestinal tract. The trocar extension2904 and the trocar head 2905 are then extended into the positionillustrated in FIG. 28( b), and the trocar head 2905 is used to puncturea closed section of the gastro-intestinal tract. The trocar head 2905 isthen removed from the distal end of the trocar extension 2904. The anvilportion 2930 is positioned within a second, adjoining section of thegastro-intestinal tract, and the trocar extension 2904 is insertedwithin the trocar receiving sleeve 2932 of the anvil portion 2930 untilthe engagement mechanisms 2938 of the trocar extension and the trocarreceiving sleeve 2932 are engaged. In this manner, the anvil portion2930 is mounted to the trocar extension 2904. The trocar extension 2904is then retracted until the anvil portion 2930 is approximately adjacentto the clamping surface 2920 of the DLU portion 2902. In this position,tissue of the gastrointestinal tract is clamped between the anvilportion 2930 and the clamping surface 2920 of the DLU portion 2902.While the trocar extension 2904 is being retracted relative to the DLUportion 2902, the trocar receiving sleeve 2934 of the anvil 2930 ispulled through the opening in the tissue that was previously made by thetrocar head 2905 of the DLU portion 2902.

As the trocar extension 2904 is further retracted relative to the DLUportion 2902, the first lens 2916 of the first image sensor portion2908, is brought into closer proximity to the second lens 2942 of thesecond image sensor portion 2934. In this manner, light, e.g., an image,is conveyed from a distal end of the bore 2940 of the anvil portion2930, through the second lens 2942, through the first lens 2916 and tothe image sensor 2918. The image sensor 2918 of the image capturearrangement 2914 may then generate image data corresponding to the imageand communicate the image data for further processing to a processor,e.g., the circuit arrangement 320 shown in FIG. 3( b) via a datatransmission cable, e.g., the data bus 430 shown in FIG. 4( b).

As previously mentioned, the surgical device 2900 illustrated in FIGS.28( a) to 28(e) provides an arrangement that enables a user to view thea surgical site without first removing the surgical device 2900 from thesurgical site. For instance, in accordance with the above-describedembodiment of the invention, a surgeon may perform an anastomosingprocedure by clamping and stapling a section of tissue between the anvilportion 2930 and the DLU portion 2902 of the surgical device 2900. Thesurgeon may then view the integrity of the stapled section of tissue viathe image sensor 2918, which is configured to provide an image of thesurgical site through the bore 2940, without the need to remove thesurgical device 2900 from the surgical site. Preferably, the surgicaldevice 2900 illustrated in FIGS. 28( a) to 28(e) may enable a full viewof the surgical site, e.g., the staple line, to be obtained by a userwithout requiring the DLU portion 2802 to be rotated within the surgicalsite.

In addition, the surgical device 2900 described hereinabove has theadvantage of eliminating the step of rotationally aligning the anvilportion 2930 with the DLU portion 2902 because, by virtue of thecentrally-disposed, “on-axis” arrangement, the image sensor 2918 of thetrocar extension 2904 is automatically aligned with the bore 2940 in theanvil portion 2930. Furthermore, the surgical device 2900 describedhereinabove has the advantage of eliminating the need for a sharp part,e.g., such as the sharp end 2942 a of the tube 2940 shown in FIG. 27(c), since the trocar receiving sleeve 2934 of the anvil 2930 is pulled,during the retraction of the trocar extension 2904 relative to the DLUportion 2902, through an opening in the tissue that was previously madeby the trocar head 2905 of the DLU portion 2902. The elimination of thesharp part reduces the likelihood of unintentionally puncturing asection of tissue during operation. In addition, the elimination of theneed to puncture the section of tissue with a sharp part may reduce thelikelihood that blood or other bodily fluids or tissue will obscure theimage received by the image sensor 2918. Consequently the need for acleaning system to clean the image sensors and/or lenses of blood orother bodily fluids or tissue that result from the puncturing of thesection of tissue with a sharp part may also be eliminated, since thelens 2942 in the anvil portion 2930 may be manually cleaned by a userprior to being mounted to the DLU portion 2902.

While there is described above various embodiments of a circularstapler, it should be recognized that the present invention may beemployed in any type of surgical device that is configured to be used ina surgical site. For instance, the present invention may be employed inany type of surgical device that has a first part, e.g., a DLU portion,that includes an image sensor, and a second part, e.g., an anvilportion, that is moveable relative to the first part and that includesan arrangement for conveying light, e.g., an image, to the image sensor.Advantageously, the arrangement of the surgical device enables an imageto be received by the image sensor without removing the surgical devicefrom the surgical site.

In various embodiments of the present invention, it may be advantageousthat the imaging sensor(s) and the lighting source(s) be separatelydisposed. For instance, while it may be desirable that the imagingsensor(s) and the light source(s) be disposed together at various times,e.g., to ensure that sufficient light is provided to enable the imagingsensor(s) to operate correctly, in other embodiments it may beadvantageous to integrate the light source with a different surgicalcomponent or attachment. In this manner, the light sources may beemployed for various purposes other than provided sufficient light toenable operation of the imaging sensors.

Referring now to FIG. 29( a), there is illustrated a surgical system3100, which may include components that are similar to the surgicalsystem 100 illustrated in FIG. 1 and are not further discussed. Thesurgical system 3100 includes an electro-mechanical driver device 3110detachably coupled via a flexible shaft 3170 to a surgical attachment3120. The surgical attachment 3120 may include any type of surgicalcomponent configured to perform any type of surgical operation. For thepurposes of example only, the surgical attachment 3120 is furtherdescribed below as an aorta clamping attachment. It should be recognizedthat, in other embodiments, the surgical attachment 3120 may be merely ahousing for the light sources and may not perform any other surgicalfunction.

The surgical attachment 3120, according to this embodiment of thepresent invention, includes one or more light sources 3150. The lightsources 3150 may be any device that is capable of providingillumination, e.g., a light emitting diode, a phosfluorescent source,fiber optics, etc. In one embodiment, the light sources 3150 may beintegrally disposed within the surgical attachment 3120. Alternatively,the light sources 3120 may be permanently attached to, or may betemporarily attachable to, the surgical attachment 3120. The surgicalattachment 3120 may also have a power source 3745, such as a smallbattery. The power source 3745 may be operable to provide electricalpower to the one or more light sources 3120.

In addition, the surgical system 3100 may include an image capturearrangement 3715. The image capture arrangement 3715 may be a device, orpart of a device, that is configured to be attachable to the flexibleshaft 3170. In this manner, the image capture arrangement 3715 mayconstitute a second surgical attachment, such as the second surgicalattachment 3700 illustrated in FIG. 29( b), and may be operated and/orcontrolled by the electromechanical driver device 3110. Alternatively,the image capture arrangement 3715 may be a device, or part of a device,that is not configured to be attachable to the flexible shaft 3170 butrather is operable and functions independently of the electro-mechanicaldriver device 3110. For example, the image capture arrangement 3715 maybe an image pod, such as the image pod illustrated in, e.g., FIG. 4( a),or a surgical imaging device, such as the surgical imaging deviceillustrated in, e.g., FIG. 10. Alternatively, the image capturearrangement 3715 may have any other possible arrangement.

FIG. 29( b) illustrates one example embodiment of the image capturearrangement 3715. The image capture arrangement 3715 may include anoptical system 3720 with a focusing lens 3735. In addition, the imagecapture arrangement 3715 may further include an imaging sensor, e.g., alight sensitive device such as a CCD 3725. When the image capturearrangement 3715 is directed toward an object to be imaged, the focusinglens 3735 focuses reflected light onto the CCD 3725. A wirelesstransmitter (or, e.g., a transceiver) 3740 may be situated in the imagecapture arrangement 3715 and may be communicatively coupled to the CCD3725. An example of such a wireless transmitter is described in U.S.Pat. No. 5,604,531, expressly incorporated herein by reference in itsentirely. Additionally, a power source 3745 a, such as a small battery,is situated in the image capture arrangement 3715 and is operable toprovide electrical power to the CCD 3725 and the wireless transmitter3740. In operation, images captured by the CCD 3725 may be wirelesslytransmitted via the wireless transmitter 3740 to a correspondingreceiver (or transceiver) in a remote device, such as theelectromechanical driver device 110.

Although, the present embodiment is described as using a CCD as an imagesensor, other suitable image sensors may also be used, such as a CMOStype image sensor. The CMOS sensor may require less power than a CCDimage sensor, due to its greater sensitivity to light. A CMOS imagesensor may include, for example, a photo diode and/or a photo transistorto detect reflected light from an object to be imaged. The CMOS imagesensor may transmit the image data as an analog signal or,alternatively, as a digital signal after processing by an analog-digitalconverter.

In operation, the surgical attachment 3120 may be inserted into asurgical site. The surgical attachment 3120, once located in thesurgical site, may then be employed to perform the type of surgicaloperation for which it is configured. In the example embodimentdescribed above, e.g., wherein the surgical attachment 3120 is an aortaclamping attachment, the surgical attachment 3120 may be inserted into asurgical site such that an aorta is positioned between its clampingsurfaces. The surgical attachment 3120 may then be operated, forinstance by and under the control of the electro-mechanical driverdevice 3110, to clamp the aorta. In one embodiment, the light sources3150 are then activated so as to provide illumination within thesurgical site. Of course, it should be recognized that the light sources3150 may be activated prior to the surgical attachment 3120 beinginserted into the surgical site.

In one embodiment, once the surgical attachment 3120 has been employedwithin the surgical site and the light sources 3150 have been activated,the surgical attachment 3120 may be detached from the flexible shaft3170. The surgical attachment 3170 may then be left within the surgicalsite such that the light sources 3150 provide illumination within thesurgical site, while the flexible shaft 3170 is removed from thesurgical site. Thereafter, the image capture arrangement 3715 may bepositioned within the surgical site so as to obtain image datacorresponding to the surgical site. As set forth more fully above, inone embodiment, the image capture arrangement 3715 is attached to theflexible shaft 3170 and is operated and controlled by theelectromechanical driver device 3110, while in other embodiments, theimage capture arrangement 3715 is operated independently from theelectro-mechanical driver device 3110.

Advantageously, the light sources 3120 provide sufficient light in thesurgical site so as to enable the image capture arrangement 3715 toobtain adequate image data corresponding to the surgical site. Forinstance, the light sources 3120 may operate to provide sufficient lightso that a user that views an image corresponding to the image data maydetermine whether or not the surgical attachment 3120 has been employedproperly. In the embodiment described above, the light sources 3120 mayoperate to provide sufficient light so that a user that views an imagecorresponding to the image data may determine whether or not an aortahas been sufficiently clamped by the aorta clamp. Additionally oralternatively, the light sources 3150 may remain in the surgical site ofthe patient, and may be employed to continue providing illumination ofthe surgical site for any other function that is required to beperformed by the operator, e.g., the insertion of a different surgicalinstrument, a physical inspection of the surgical site by the operator,etc.

While FIGS. 29( a) and 29(b) illustrate one example embodiment of asurgical system that includes imaging sensors and lighting source(s)that are separately disposed, it should be recognized that the presentinvention may also include various other configurations by which theimaging sensors and the lighting source(s) may be separately disposed ordisposable.

Several embodiments of the present invention are specificallyillustrated and/or described herein. However, it will be appreciatedthat modifications and variations of the present invention are coveredby the above teachings without departing from the spirit and intendedscope of the present invention.

1. A surgical imaging device, comprising: at least one light source forilluminating an object; at least two image sensors, each image sensorconfigured to generate image data corresponding to the object in theform of an image frame, each image frame partially overlapping with atleast one other image frame, each of the image sensors corresponding toa different point of view with respect to the object; and a videoprocessor configured to receive simultaneously from each image sensorthe image data corresponding to the image frames and to process theimage data by combining the image frames to generate a composite imagefrom the combined image frames, each image frame corresponding to asubportion of the composite image, wherein the at least two imagesensors are positioned opposite from one another such that the compositeimage is generated therebetween and each opposing image sensor is angledtowards its respective point of view to generate the composite imagebetween the at least two opposing image sensors.
 2. The device of claim1, wherein the surgical imaging device is configured to be inserted intoa body of a patient.
 3. The device of claim 2, wherein the videoprocessor stitches the image data received from each image sensor byprocessing a portion of image data received from one image sensor thatoverlaps with a portion of image data received from another imagesensor.
 4. The device of claim 1, wherein the surgical imaging device isconfigured to be inserted into an abdominal cavity of a patient.
 5. Thedevice of claim 1, wherein the composite image corresponds to an entireabdominal cavity of a patient.
 6. The device of claim 1, wherein thevideo processor is configured to normalize the image data received fromeach image sensor.
 7. The device of claim 1, wherein the video processoris configured to orient the image data received from each image sensor.8. The device of claim 1, wherein the video processor is configured tostitch the image data received from each image sensor so as to generatethe composite image.
 9. The device of claim 1, wherein the videoprocessor is configured to one of establish or adjust orientation datapoints of the composite image.
 10. The device of claim 9, wherein thevideo processor one of establishes or adjusts orientation data points ofthe composite image by a control device that moves one or more of theimage sensors.
 11. The device of claim 1, wherein the video processor isconfigured to selectively generate a region of interest corresponding toa portion of the composite image.
 12. The device of claim 11, whereinthe video processor selectively generates the region of interestcorresponding to a portion of the composite image in accordance withsignals received from a control device.
 13. The device of claim 11,wherein the video processor is configured to automatically adjust theregion of interest.
 14. The device of claim 13, wherein the videoprocessor automatically adjusts the region of interest so as tocontinuously display a surgical instrument as the surgical instrument ismoved.
 15. The device of claim 1, wherein the video processor isconfigured to selectively generate a region of interest corresponding tosignals received from a user input device to zoom into or out of aportion of the composite image.
 16. The device of claim 1, furthercomprising a display device coupled to the video processor, the videoprocessor configured to generates a display image for display on thedisplay device.
 17. The device of claim 16, wherein the display deviceis a wireless personal display monitor.
 18. The device of claim 16,wherein the display device is an overhead display monitor.
 19. Thedevice of claim 1, wherein the composite image has an aspect ratio of16:9.
 20. The device of claim 1, wherein the composite image has anaspect ratio of 4:3.
 21. A method for generating an image comprising thesteps of: illuminating an object in a surgical site; simultaneouslygenerating, via at least two image sensors, at least two sets of imagedata corresponding to the object, each of the image sensorscorresponding to a different point of view, each set of image datapartially overlapping at least one other set of image data, wherein theat least two image sensors are positioned opposite from one another suchthat the composite image is generated therebetween and each opposingimage sensor is angled towards its respective point of view to generatethe composite image between the at least two opposing image sensors; andcombining the at least two sets of image data so as to generate acomposite image from the combined image data, each set of image datacorresponding to a subportion of the composite image.
 22. The method ofclaim 21, further comprising the step of generating the image inside abody of a patient.
 23. The method of claim 21, further comprising thestep of inserting the surgical imaging device into an abdominal cavityof a patient.
 24. The method of claim 23, wherein the processing stepincludes generating the composite image of an entire abdominal cavity ofa patient.
 25. The method of claim 21, further comprising the step ofnormalizing the image data received from each image sensor.
 26. Themethod of claim 21, further comprising the step of orienting the imagedata received from each image sensor.
 27. The method of claim 21,further comprising the step of stitching the image data received fromeach image sensor so as to generate the composite image.
 28. The methodof claim 27, wherein the stitching includes processing a portion ofimage data received from one image sensor that overlaps with a portionof image data received from another image sensor.
 29. The method ofclaim 21, further comprising the step of establishing or adjustingorientation data points of the composite image.
 30. The method of claim29, wherein the step of establishing or adjusting the orientation datapoints of the composite image is performed by a control device thatmoves one or more of the image sensors.
 31. The method of claim 21,further comprising the step of selectively generating a region ofinterest corresponding to a portion of the composite image.
 32. Themethod of claim 31, wherein the step of selectively generating theregion of interest corresponding to a portion of the composite imageincludes processing signals received from a control device.
 33. Themethod of claim 31, further comprising the step of automaticallyadjusting the region of interest.
 34. The method of claim 33, whereinthe step of automatically adjusting the region of interest includescontinuously displaying a surgical instrument as the surgical instrumentis moved.
 35. The method of claim 31, wherein the step of selectivelygenerating a region of interest includes processing signals receivedfrom a user input device to zoom into or out of a portion of thecomposite image.
 36. The method of claim 21, further comprising thesteps of: generating a display image; and display the display image onthe display device.
 37. The method of claim 36, wherein the displayingstep includes displaying the display image on a wireless personaldisplay monitor.
 38. The method of claim 36, wherein the displaying stepincludes displaying the display image on an overhead display monitor.39. The method of claim 21, wherein the processing step includesgenerating the composite image so as to have an aspect ratio of 16:9.40. The method of claim 21, wherein the processing step includesgenerating the composite image so as to have an aspect ratio of 4:3.